>>> kops: Building testing/kops 1.28.4-r13 (using abuild 3.15.0-r3) started Fri, 05 Sep 2025 06:05:51 +0000 >>> kops: Validating /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/4) Installing kubernetes (1.33.4-r1) (2/4) Installing go (1.25.1-r0) (3/4) Installing bash (5.3.3-r1) bash-5.3.3-r1.post-install: Executing script... (4/4) Installing .makedepends-kops (20250905.060552) busybox-1.37.0-r23.trigger: Executing script... OK: 587 MiB in 110 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz Connecting to distfiles.alpinelinux.org (172.105.82.32:443) saving to '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' kops-1.28.4.tar.gz.p 100% |********************************| 32.7M 0:00:00 ETA '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' saved >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz >>> kops: Checking sha512sums... kops-1.28.4.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.4.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.4 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading golang.org/x/crypto v0.14.0 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading github.com/spf13/cobra v1.7.0 go: downloading k8s.io/apimachinery v0.28.1 go: downloading k8s.io/client-go v0.28.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading k8s.io/api v0.28.1 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading github.com/spf13/pflag v1.0.5 go: downloading go.uber.org/multierr v1.11.0 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading k8s.io/kubectl v0.28.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading k8s.io/klog v1.0.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading golang.org/x/sync v0.3.0 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading golang.org/x/net v0.17.0 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/google/uuid v1.3.1 go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/gogo/protobuf v1.3.2 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading github.com/google/gofuzz v1.2.0 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading github.com/pkg/errors v0.9.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading github.com/kr/fs v0.1.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading golang.org/x/term v0.13.0 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading golang.org/x/text v0.13.0 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading golang.org/x/sys v0.13.0 go: downloading github.com/json-iterator/go v1.1.12 go: downloading google.golang.org/protobuf v1.31.0 go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/moby/locker v1.0.1 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/google/s2a-go v0.1.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/josharian/intern v1.0.0 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/docker/go-metrics v0.0.1 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading github.com/stretchr/testify v1.8.4 go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I0905 06:07:21.604376 18822 addon.go:250] addon test wants to update all nodes I0905 06:07:21.606615 18822 addon.go:250] addon test wants to update workers nodes I0905 06:07:21.606909 18822 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I0905 06:07:21.607162 18822 addon.go:283] installing PKI for "test" I0905 06:07:21.730535 18822 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.19s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.229s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.041s ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN TestCreateClusterMinimal I0905 06:07:25.027842 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.028024 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.028054 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.028085 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.028104 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.028135 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.028159 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.028170 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.028203 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.028234 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.031545 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.031594 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.060531 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.060662 20117 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0905 06:07:25.060898 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:25.069212 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.069309 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.069327 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.069345 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.069359 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.069377 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.069393 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.069401 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.069415 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.069425 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.072312 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.072355 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.106385 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.106559 20117 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0905 06:07:25.106904 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:25.110445 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.110563 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.110581 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.110603 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.110616 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.110634 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.110650 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.110660 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.110675 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.110687 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.112929 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.112954 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.131570 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.131675 20117 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0905 06:07:25.131830 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:25.135029 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.135121 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.135135 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.135152 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.135164 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.135180 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.135194 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.135202 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.135216 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.135227 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.137274 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.137304 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.196381 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.196554 20117 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0905 06:07:25.196844 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:25.202190 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.202340 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.202373 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.202401 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.202420 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.202452 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.202478 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.202491 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.202512 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.202527 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.208025 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.208076 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.228203 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.228357 20117 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0905 06:07:25.228653 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:25.235878 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.236010 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.236033 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.236064 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.236082 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.236103 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.236122 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.236133 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.236153 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.236165 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.258730 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.258823 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.308120 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.308220 20117 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0905 06:07:25.308515 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:25.312651 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.312757 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.312776 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.312794 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.312823 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.312844 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.312861 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.312871 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.312888 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.312900 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.315174 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.315198 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.329176 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.329295 20117 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0905 06:07:25.329496 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.31s) === RUN TestCreateClusterHetzner I0905 06:07:25.333469 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.333609 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.333626 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.333647 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.333661 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.333683 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.333700 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.333710 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.333725 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.333739 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.336400 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.336427 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0905 06:07:25.375605 20117 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0905 06:07:25.375634 20117 new_cluster.go:1373] Cloud Provider ID: "hetzner" I0905 06:07:25.379704 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.379810 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.379828 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.379846 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.379858 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.379877 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.379894 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.379902 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.379919 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.379929 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.382547 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.382579 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.407989 20117 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.08s) === RUN TestCreateClusterOpenStack I0905 06:07:25.415716 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.415919 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.415952 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.415996 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.416023 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.416056 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.416083 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.416101 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.416126 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.416147 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.419719 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.419743 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0905 06:07:25.431644 20117 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0905 06:07:25.431681 20117 new_cluster.go:1373] Cloud Provider ID: "openstack" I0905 06:07:25.432889 20117 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.02s) === RUN TestCreateClusterOpenStackOctavia I0905 06:07:25.437325 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.437421 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.437441 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.437458 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.437473 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.437490 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.437505 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.437515 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.437529 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.437539 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.439644 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.439675 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0905 06:07:25.449297 20117 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0905 06:07:25.449336 20117 new_cluster.go:1373] Cloud Provider ID: "openstack" I0905 06:07:25.450364 20117 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0905 06:07:25.450377 20117 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.02s) === RUN TestCreateClusterOpenStackNoDNS I0905 06:07:25.454888 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.454984 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.455000 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.455016 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.455029 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.455046 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.455060 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.455069 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.455082 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.455091 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.457203 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.457246 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0905 06:07:25.495419 20117 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0905 06:07:25.495494 20117 new_cluster.go:1373] Cloud Provider ID: "openstack" I0905 06:07:25.495547 20117 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0905 06:07:25.495571 20117 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.05s) === RUN TestCreateClusterCilium I0905 06:07:25.505881 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.506081 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.506114 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.506153 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.506179 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.506211 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.506238 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.506261 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.506287 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.506309 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.509970 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.509998 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.529439 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.529772 20117 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0905 06:07:25.530267 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.03s) === RUN TestCreateClusterOverride I0905 06:07:25.537244 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.537377 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.537400 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.537424 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.537442 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.537465 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.537484 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.537496 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.537514 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.537527 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.541436 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.541492 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.586888 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.587349 20117 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0905 06:07:25.587644 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.06s) === RUN TestCreateClusterKubernetesFeatureGates I0905 06:07:25.593347 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.593481 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.593504 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.593528 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.593550 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.593573 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.593595 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.593609 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.593628 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.593650 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.628685 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.628724 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.651729 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.651856 20117 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0905 06:07:25.652137 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.06s) === RUN TestCreateClusterComplex I0905 06:07:25.657857 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.657972 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.657993 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.658014 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.658030 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.658051 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.658068 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.658080 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.658096 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.658110 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.660989 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.661016 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.709802 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.709981 20117 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I0905 06:07:25.709989 20117 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I0905 06:07:25.709993 20117 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I0905 06:07:25.710161 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.06s) === RUN TestCreateClusterComplexPrivate I0905 06:07:25.718951 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.719119 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.719146 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.719182 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.719203 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.719234 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.719260 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.719274 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.719294 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.719308 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.723755 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.723809 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.765253 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.765754 20117 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I0905 06:07:25.765772 20117 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I0905 06:07:25.765779 20117 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I0905 06:07:25.765785 20117 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I0905 06:07:25.765800 20117 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I0905 06:07:25.765807 20117 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I0905 06:07:25.765813 20117 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I0905 06:07:25.765830 20117 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I0905 06:07:25.765846 20117 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I0905 06:07:25.765860 20117 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I0905 06:07:25.766325 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.06s) === RUN TestCreateClusterHA I0905 06:07:25.779615 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.779764 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.779788 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.779814 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.779835 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.779861 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.779884 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.779898 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.779928 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.779942 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.783394 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.783430 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.818656 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.818934 20117 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0905 06:07:25.818951 20117 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0905 06:07:25.818961 20117 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0905 06:07:25.819197 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:25.826167 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.826266 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.826285 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.826304 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.826319 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.826338 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.826359 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.826369 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.826384 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.826397 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.829315 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.829343 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.851716 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:25.851953 20117 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0905 06:07:25.851972 20117 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0905 06:07:25.851980 20117 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0905 06:07:25.852262 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.08s) === RUN TestCreateClusterMinimalGCE I0905 06:07:25.860287 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.860522 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.860963 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.861027 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.861068 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.861116 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.861155 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.861183 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.861228 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.861255 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.864920 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.864948 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.893192 20117 new_cluster.go:1373] Cloud Provider ID: "gce" I0905 06:07:25.893284 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I0905 06:07:25.897354 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.897463 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.897481 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.897498 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.897513 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.897531 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.897548 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.897557 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.897571 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.897581 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.900552 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.900581 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.943351 20117 new_cluster.go:1373] Cloud Provider ID: "gce" I0905 06:07:25.943413 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.09s) === RUN TestCreateClusterHAGCE I0905 06:07:25.946800 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.946900 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.946916 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.946932 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.946946 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.946962 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.946976 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.946985 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.946998 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.947007 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.949335 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.949363 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.959604 20117 new_cluster.go:1373] Cloud Provider ID: "gce" I0905 06:07:25.959703 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.02s) === RUN TestCreateClusterGCE I0905 06:07:25.966318 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.966431 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.966450 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.966468 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.966483 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.966503 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.966520 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.966543 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.966559 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.966570 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.969053 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.969074 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.985284 20117 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0905 06:07:25.985325 20117 new_cluster.go:1373] Cloud Provider ID: "gce" I0905 06:07:25.985376 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.02s) === RUN TestCreateClusterHASharedZone I0905 06:07:25.988612 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:25.988710 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:25.988725 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:25.988741 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:25.988755 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:25.988771 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:25.988795 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:25.988805 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:25.988819 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:25.988828 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:25.991647 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:25.991691 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0905 06:07:26.029077 20117 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0905 06:07:26.029145 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.029523 20117 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0905 06:07:26.030025 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.05s) === RUN TestCreateClusterHASharedZones I0905 06:07:26.035597 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.035705 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.035724 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.035764 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.035783 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.035808 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.035827 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.035843 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.035867 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.035880 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.038168 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.038202 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0905 06:07:26.065265 20117 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0905 06:07:26.065296 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.065693 20117 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I0905 06:07:26.065709 20117 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I0905 06:07:26.065943 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.04s) === RUN TestCreateClusterPrivate I0905 06:07:26.074354 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.074462 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.074480 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.074502 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.074520 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.074541 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.074560 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.074575 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.074592 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.074605 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.077194 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.077246 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.149893 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.150084 20117 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0905 06:07:26.150099 20117 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0905 06:07:26.150357 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:26.150396 20117 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.08s) === RUN TestCreateClusterPrivateGCE I0905 06:07:26.155534 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.155667 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.155686 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.155711 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.155727 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.155748 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.155765 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.155780 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.155803 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.155814 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.159307 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.159336 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.193373 20117 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0905 06:07:26.193459 20117 new_cluster.go:1373] Cloud Provider ID: "gce" I0905 06:07:26.193568 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.04s) === RUN TestCreateClusterWithNGWSpecified I0905 06:07:26.200442 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.200603 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.200631 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.200660 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.200682 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.200710 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.200736 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.200753 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.200774 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.200789 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.203854 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.203884 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.223917 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.224034 20117 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0905 06:07:26.224045 20117 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0905 06:07:26.224228 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:26.224254 20117 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.03s) === RUN TestCreateClusterWithINGWSpecified I0905 06:07:26.234382 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.234576 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.234608 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.234657 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.234682 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.234723 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.234751 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.234769 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.234806 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.234828 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.238784 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.238837 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.320005 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.320165 20117 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0905 06:07:26.320177 20117 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0905 06:07:26.320395 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:26.320415 20117 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.09s) === RUN TestCreateClusterSharedVPC I0905 06:07:26.324298 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.324394 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.324410 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.324429 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.324442 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.324458 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.324475 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.324483 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.324497 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.324508 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.327825 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.327848 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.335050 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.335120 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.335148 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.335164 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.335171 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.335190 20117 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I0905 06:07:26.335308 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.01s) === RUN TestCreateClusterSharedSubnets I0905 06:07:26.338273 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.338359 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.338372 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.338384 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.338396 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.338410 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.338420 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.338429 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.338439 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.338446 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.340948 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.340967 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.366712 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.366729 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.366763 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.366842 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.366853 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.366866 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.366873 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.366997 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.03s) === RUN TestCreateClusterSharedSubnetsVpcLookup I0905 06:07:26.370071 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.370163 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.370177 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.370190 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.370202 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.370217 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.370229 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.370239 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.370250 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.370259 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.373199 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.373222 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.387010 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:07:26.387038 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.387047 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.387079 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.387156 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.387167 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.387178 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.387185 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.387308 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.02s) === RUN TestCreateClusterPrivateSharedSubnets I0905 06:07:26.390305 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.390394 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.390408 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.390421 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.390432 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.390446 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.390457 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.390464 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.390476 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.390483 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.394152 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.394201 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.444581 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.444617 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.444655 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.444665 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.444702 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.444791 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.444803 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.444816 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:07:26.444824 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:07:26.445068 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.06s) === RUN TestCreateClusterIPv6 I0905 06:07:26.449325 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.449445 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.449464 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.449483 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.449498 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.449517 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.449534 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.449545 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.449560 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.449571 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.453448 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.453510 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.514818 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.514973 20117 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I0905 06:07:26.514990 20117 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I0905 06:07:26.515439 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.07s) === RUN TestCreateClusterDifferentAMIs I0905 06:07:26.521072 20117 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0905 06:07:26.521084 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.521584 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.521604 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.521624 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.521640 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.521659 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.521678 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.521688 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.521704 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.521716 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.525017 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.525060 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.574993 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.575102 20117 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0905 06:07:26.575120 20117 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0905 06:07:26.575409 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:26.581640 20117 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.06s) === RUN TestCreateClusterKarpenter I0905 06:07:26.581743 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.581872 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.581894 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.581920 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.581939 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.581961 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.581983 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.582003 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.582022 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.582036 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.585023 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.585058 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0905 06:07:26.618001 20117 new_cluster.go:1373] Cloud Provider ID: "aws" I0905 06:07:26.618139 20117 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0905 06:07:26.618152 20117 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0905 06:07:26.618161 20117 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0905 06:07:26.618445 20117 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.04s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I0905 06:07:26.623272 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.623383 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.623402 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.623457 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.623474 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.623495 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.623522 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.623532 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.623548 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.623561 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.627209 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.00s) === RUN TestMinimal I0905 06:07:26.628093 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:26.628186 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:26.628201 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:26.628216 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:26.628227 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:26.628243 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:26.628258 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:26.628268 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:26.628280 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:26.628289 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:26.642806 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0905 06:07:26.644510 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:26.644559 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0905 06:07:31.110175 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:32.929168 20117 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0905 06:07:32.930319 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:32.930347 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:32.930435 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:32.932591 20117 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0905 06:07:32.935803 20117 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0905 06:07:32.936395 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:32.936580 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:32.936992 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:32.937181 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:32.937271 20117 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0905 06:07:32.937615 20117 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0905 06:07:32.938004 20117 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0905 06:07:32.943200 20117 target.go:111] Terraform output is in /tmp/test3318871562/out --- PASS: TestMinimal (6.32s) === RUN TestMinimal_v1_23 I0905 06:07:32.947419 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:32.947591 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:32.947622 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:32.947657 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:32.947683 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:32.947718 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:32.947750 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:32.947770 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:32.947797 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:32.947816 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:32.971048 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0905 06:07:32.975738 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:32.975841 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:34.357199 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:34.468777 20117 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0905 06:07:34.469013 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:34.469032 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:34.469091 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:34.471509 20117 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0905 06:07:34.475665 20117 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0905 06:07:34.475878 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:34.475977 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:34.476263 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:34.476413 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:34.476503 20117 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0905 06:07:34.476690 20117 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0905 06:07:34.476889 20117 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0905 06:07:34.482297 20117 target.go:111] Terraform output is in /tmp/test1273822593/out --- PASS: TestMinimal_v1_23 (1.54s) === RUN TestMinimal_v1_24 I0905 06:07:34.486723 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:34.486901 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:34.486932 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:34.486975 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:34.487004 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:34.487039 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:34.487069 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:34.487091 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:34.487118 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:34.487143 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:34.506775 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:07:34.509625 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:34.509692 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:35.751585 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:35.886484 20117 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0905 06:07:35.886977 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:35.887016 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:35.887092 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:35.889504 20117 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0905 06:07:35.893589 20117 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0905 06:07:35.893922 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:35.894103 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:35.894283 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:35.894649 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:35.894732 20117 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0905 06:07:35.894964 20117 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0905 06:07:35.895179 20117 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0905 06:07:35.900781 20117 target.go:111] Terraform output is in /tmp/test2299662492/out --- PASS: TestMinimal_v1_24 (1.42s) === RUN TestMinimal_v1_25 I0905 06:07:35.905164 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:35.905335 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:35.905367 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:35.905400 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:35.905431 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:35.905493 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:35.905523 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:35.905543 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:35.905568 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:35.905587 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:35.926961 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0905 06:07:35.930939 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:35.931008 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:36.915880 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:37.055964 20117 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0905 06:07:37.056462 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:37.056509 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:37.056629 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:37.059404 20117 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0905 06:07:37.063702 20117 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0905 06:07:37.064012 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:37.064236 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:37.064575 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:37.064645 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:37.064902 20117 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0905 06:07:37.065123 20117 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0905 06:07:37.065397 20117 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0905 06:07:37.070900 20117 target.go:111] Terraform output is in /tmp/test2324163860/out --- PASS: TestMinimal_v1_25 (1.17s) === RUN TestMinimal_v1_26 I0905 06:07:37.077718 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:37.077926 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:37.077958 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:37.077994 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:37.078026 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:37.078060 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:37.078093 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:37.078112 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:37.078138 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:37.078158 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:37.098492 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0905 06:07:37.101062 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:37.101126 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:38.262101 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:38.399350 20117 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0905 06:07:38.400126 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:38.400164 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:38.400255 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:38.402202 20117 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0905 06:07:38.408153 20117 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0905 06:07:38.412425 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:38.412691 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:38.413055 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:38.413106 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:38.413204 20117 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0905 06:07:38.413428 20117 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0905 06:07:38.413681 20117 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0905 06:07:38.419374 20117 target.go:111] Terraform output is in /tmp/test1271877708/out --- PASS: TestMinimal_v1_26 (1.35s) === RUN TestMinimal_v1_27 I0905 06:07:38.423989 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:38.424195 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:38.424231 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:38.424269 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:38.424300 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:38.424338 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:38.424368 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:38.424387 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:38.424413 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:38.424434 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:38.444552 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0905 06:07:38.447160 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:38.447227 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:40.906095 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:41.043515 20117 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0905 06:07:41.044242 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:41.044270 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:41.044342 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:41.046742 20117 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0905 06:07:41.051094 20117 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0905 06:07:41.051466 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:41.051636 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:41.051828 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:41.052192 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:41.052280 20117 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0905 06:07:41.052522 20117 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0905 06:07:41.052754 20117 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0905 06:07:41.058370 20117 target.go:111] Terraform output is in /tmp/test1591058236/out --- PASS: TestMinimal_v1_27 (2.64s) === RUN TestMinimal_NoneDNS I0905 06:07:41.062887 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:41.063084 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:41.063140 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:41.063180 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:41.063209 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:41.063243 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:41.063273 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:41.063293 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:41.063324 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:41.063345 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0905 06:07:41.086434 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:41.086499 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:41.766783 20117 executor.go:111] Tasks: 0 done / 110 total; 43 can run I0905 06:07:41.769937 20117 executor.go:111] Tasks: 43 done / 110 total; 24 can run I0905 06:07:41.771869 20117 executor.go:111] Tasks: 67 done / 110 total; 29 can run I0905 06:07:41.772552 20117 executor.go:111] Tasks: 96 done / 110 total; 2 can run I0905 06:07:41.772613 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:07:41.772672 20117 loadbalancers.go:35] PageSize not implemented I0905 06:07:41.772790 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:07:41.772922 20117 loadbalancers.go:35] PageSize not implemented I0905 06:07:41.780338 20117 executor.go:111] Tasks: 98 done / 110 total; 4 can run I0905 06:07:41.780541 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:41.780726 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:41.781117 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:41.781207 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:41.781289 20117 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0905 06:07:41.781514 20117 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0905 06:07:41.781820 20117 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0905 06:07:41.787652 20117 target.go:111] Terraform output is in /tmp/test3005524992/out --- PASS: TestMinimal_NoneDNS (0.73s) === RUN TestHetzner I0905 06:07:41.791914 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:07:43.070507 20117 executor.go:111] Tasks: 0 done / 46 total; 37 can run I0905 06:07:43.074431 20117 executor.go:111] Tasks: 37 done / 46 total; 3 can run I0905 06:07:43.074687 20117 executor.go:111] Tasks: 40 done / 46 total; 2 can run I0905 06:07:43.078501 20117 executor.go:111] Tasks: 42 done / 46 total; 4 can run I0905 06:07:43.079189 20117 executor.go:111] Tasks: 46 done / 46 total; 0 can run I0905 06:07:43.081185 20117 target.go:111] Terraform output is in /tmp/test958687443/out --- PASS: TestHetzner (1.29s) === RUN TestNvidia I0905 06:07:43.082973 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:43.083092 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:43.083118 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:43.083147 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:43.083167 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:43.083194 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:43.083218 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:43.083231 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:43.083251 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:43.083272 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:43.096071 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:07:43.097785 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:43.097835 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.079000 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:44.171907 20117 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0905 06:07:44.175894 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:44.175949 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:44.176018 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:44.181152 20117 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0905 06:07:44.186307 20117 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0905 06:07:44.186641 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.186820 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.187023 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.187094 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.187148 20117 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0905 06:07:44.187283 20117 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0905 06:07:44.187417 20117 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0905 06:07:44.192609 20117 target.go:111] Terraform output is in /tmp/test2482312899/out --- PASS: TestNvidia (1.11s) === RUN TestMinimalGossip I0905 06:07:44.197099 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:44.197277 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:44.197311 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:44.197345 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:44.197372 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:44.197407 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:44.197434 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:44.197452 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:44.197483 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:44.197503 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:07:44.216803 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.216861 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.938828 20117 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0905 06:07:44.942203 20117 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0905 06:07:44.948075 20117 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0905 06:07:44.948390 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.948905 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.950801 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.951174 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.951256 20117 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0905 06:07:44.951500 20117 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0905 06:07:44.951713 20117 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0905 06:07:44.957122 20117 target.go:111] Terraform output is in /tmp/test2261874364/out --- PASS: TestMinimalGossip (0.76s) === RUN TestMinimalGossipIRSA I0905 06:07:44.961422 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:44.961595 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:44.961627 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:44.961668 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:44.961697 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:44.961733 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:44.961762 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:44.961782 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:44.961808 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:44.961827 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:07:44.983133 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:44.983199 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:45.726177 20117 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0905 06:07:45.729264 20117 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0905 06:07:45.732986 20117 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0905 06:07:45.733367 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:45.733610 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:45.733736 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:45.733958 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:45.734038 20117 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0905 06:07:45.734242 20117 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0905 06:07:45.734428 20117 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0905 06:07:45.744140 20117 target.go:111] Terraform output is in /tmp/test2292584774/out --- PASS: TestMinimalGossipIRSA (0.79s) === RUN TestMinimalGCE I0905 06:07:45.750078 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:45.751484 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:07:46.933623 20117 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0905 06:07:46.933694 20117 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0905 06:07:46.933778 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0905 06:07:46.933797 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0905 06:07:46.933809 20117 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0905 06:07:46.933845 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0905 06:07:46.934582 20117 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0905 06:07:46.937742 20117 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0905 06:07:46.941903 20117 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0905 06:07:46.942847 20117 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0905 06:07:46.943094 20117 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0905 06:07:46.950860 20117 target.go:111] Terraform output is in /tmp/test3463833150/out --- PASS: TestMinimalGCE (1.21s) === RUN TestMinimalGCEPrivate I0905 06:07:46.955872 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:46.957780 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:07:47.910703 20117 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0905 06:07:47.910757 20117 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0905 06:07:47.910814 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W0905 06:07:47.910825 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W0905 06:07:47.910833 20117 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W0905 06:07:47.910858 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0905 06:07:47.911387 20117 executor.go:111] Tasks: 0 done / 65 total; 41 can run I0905 06:07:47.913607 20117 executor.go:111] Tasks: 41 done / 65 total; 17 can run I0905 06:07:47.916644 20117 executor.go:111] Tasks: 58 done / 65 total; 5 can run I0905 06:07:47.917295 20117 executor.go:111] Tasks: 63 done / 65 total; 2 can run I0905 06:07:47.917423 20117 executor.go:111] Tasks: 65 done / 65 total; 0 can run I0905 06:07:47.919773 20117 target.go:111] Terraform output is in /tmp/test1674699234/out --- PASS: TestMinimalGCEPrivate (0.97s) === RUN TestMinimalGCEInternalLoadBalancer I0905 06:07:47.921945 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:47.923224 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:07:48.866504 20117 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0905 06:07:48.866544 20117 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0905 06:07:48.866610 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W0905 06:07:48.866619 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W0905 06:07:48.866627 20117 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W0905 06:07:48.866651 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0905 06:07:48.866669 20117 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0905 06:07:48.867271 20117 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0905 06:07:48.868951 20117 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0905 06:07:48.869203 20117 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0905 06:07:48.869362 20117 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0905 06:07:48.871147 20117 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0905 06:07:48.871590 20117 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0905 06:07:48.871670 20117 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0905 06:07:48.871830 20117 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0905 06:07:48.871963 20117 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0905 06:07:48.874631 20117 target.go:111] Terraform output is in /tmp/test3693573633/out --- PASS: TestMinimalGCEInternalLoadBalancer (0.95s) === RUN TestMinimalGCEPublicLoadBalancer I0905 06:07:48.876740 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:48.877838 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:07:49.819402 20117 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0905 06:07:49.819532 20117 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0905 06:07:49.819812 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W0905 06:07:49.819844 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W0905 06:07:49.819868 20117 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W0905 06:07:49.819984 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0905 06:07:49.822406 20117 executor.go:111] Tasks: 0 done / 71 total; 43 can run I0905 06:07:49.825333 20117 executor.go:111] Tasks: 43 done / 71 total; 19 can run I0905 06:07:49.829542 20117 executor.go:111] Tasks: 62 done / 71 total; 7 can run I0905 06:07:49.830211 20117 executor.go:111] Tasks: 69 done / 71 total; 2 can run I0905 06:07:49.830366 20117 executor.go:111] Tasks: 71 done / 71 total; 0 can run I0905 06:07:49.833882 20117 target.go:111] Terraform output is in /tmp/test1920916892/out --- PASS: TestMinimalGCEPublicLoadBalancer (0.96s) === RUN TestMinimalGCELongClusterName I0905 06:07:49.837262 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:49.838691 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:07:50.784137 20117 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0905 06:07:50.784201 20117 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0905 06:07:50.784262 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0905 06:07:50.784275 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0905 06:07:50.784284 20117 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0905 06:07:50.784314 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0905 06:07:50.784905 20117 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0905 06:07:50.787501 20117 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0905 06:07:50.792278 20117 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0905 06:07:50.792935 20117 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0905 06:07:50.793057 20117 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0905 06:07:50.796687 20117 target.go:111] Terraform output is in /tmp/test2580358140/out --- PASS: TestMinimalGCELongClusterName (0.96s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I0905 06:07:50.800038 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:50.801882 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:07:51.760135 20117 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0905 06:07:51.760171 20117 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0905 06:07:51.760238 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0905 06:07:51.760246 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0905 06:07:51.760255 20117 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0905 06:07:51.760281 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0905 06:07:51.760305 20117 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0905 06:07:51.760893 20117 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0905 06:07:51.763876 20117 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0905 06:07:51.765538 20117 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0905 06:07:51.765802 20117 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0905 06:07:51.768756 20117 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0905 06:07:51.769507 20117 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0905 06:07:51.769603 20117 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0905 06:07:51.769698 20117 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0905 06:07:51.769795 20117 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0905 06:07:51.772592 20117 target.go:111] Terraform output is in /tmp/test2809221234/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (0.97s) === RUN TestMinimalGCEDNSNone I0905 06:07:51.774803 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:51.776180 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:07:52.750050 20117 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0905 06:07:52.750120 20117 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0905 06:07:52.750236 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0905 06:07:52.750255 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0905 06:07:52.750273 20117 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0905 06:07:52.750326 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0905 06:07:52.750361 20117 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0905 06:07:52.751605 20117 executor.go:111] Tasks: 0 done / 72 total; 41 can run I0905 06:07:52.753887 20117 executor.go:111] Tasks: 41 done / 72 total; 18 can run I0905 06:07:52.754317 20117 executor.go:111] Tasks: 59 done / 72 total; 2 can run I0905 06:07:52.754505 20117 executor.go:111] Tasks: 61 done / 72 total; 2 can run I0905 06:07:52.758756 20117 executor.go:111] Tasks: 63 done / 72 total; 4 can run I0905 06:07:52.759499 20117 executor.go:111] Tasks: 67 done / 72 total; 2 can run I0905 06:07:52.759657 20117 executor.go:111] Tasks: 69 done / 72 total; 1 can run I0905 06:07:52.759790 20117 executor.go:111] Tasks: 70 done / 72 total; 2 can run I0905 06:07:52.759983 20117 executor.go:111] Tasks: 72 done / 72 total; 0 can run I0905 06:07:52.768350 20117 target.go:111] Terraform output is in /tmp/test1760207796/out --- PASS: TestMinimalGCEDNSNone (1.00s) === RUN TestMinimalScaleway I0905 06:07:52.772911 20117 featureflag.go:164] FeatureFlag "Scaleway"=true I0905 06:07:52.772927 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:07:53.868693 20117 executor.go:111] Tasks: 0 done / 49 total; 37 can run I0905 06:07:53.870720 20117 executor.go:111] Tasks: 37 done / 49 total; 6 can run I0905 06:07:53.872884 20117 executor.go:111] Tasks: 43 done / 49 total; 6 can run I0905 06:07:53.873518 20117 executor.go:111] Tasks: 49 done / 49 total; 0 can run I0905 06:07:53.875366 20117 target.go:111] Terraform output is in /tmp/test756375608/out I0905 06:07:53.877599 20117 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (1.10s) === RUN TestHA I0905 06:07:53.877717 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:53.877845 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:53.877872 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:53.877905 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:53.877931 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:53.877960 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:53.877996 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:53.878010 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:53.878031 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:53.878048 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:53.892298 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:07:53.893560 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:53.893593 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:53.893612 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:53.893629 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:54.485198 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:54.600668 20117 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0905 06:07:54.601098 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:54.601132 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:54.601215 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:54.603323 20117 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0905 06:07:54.607937 20117 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0905 06:07:54.608110 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:54.608310 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:54.608441 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:54.608564 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:54.608657 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:54.608720 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:54.608859 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:54.608928 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:54.609447 20117 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0905 06:07:54.609722 20117 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0905 06:07:54.609979 20117 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0905 06:07:54.616769 20117 target.go:111] Terraform output is in /tmp/test3463250666/out --- PASS: TestHA (0.74s) === RUN TestHighAvailabilityGCE I0905 06:07:54.622097 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:54.623716 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:07:55.643267 20117 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0905 06:07:55.643346 20117 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0905 06:07:55.643460 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W0905 06:07:55.643482 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W0905 06:07:55.643501 20117 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W0905 06:07:55.643549 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0905 06:07:55.643607 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0905 06:07:55.643656 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0905 06:07:55.645029 20117 executor.go:111] Tasks: 0 done / 82 total; 49 can run I0905 06:07:55.648876 20117 executor.go:111] Tasks: 49 done / 82 total; 19 can run I0905 06:07:55.653326 20117 executor.go:111] Tasks: 68 done / 82 total; 8 can run I0905 06:07:55.654295 20117 executor.go:111] Tasks: 76 done / 82 total; 6 can run I0905 06:07:55.655476 20117 executor.go:111] Tasks: 82 done / 82 total; 0 can run I0905 06:07:55.663037 20117 target.go:111] Terraform output is in /tmp/test973123835/out --- PASS: TestHighAvailabilityGCE (1.05s) === RUN TestComplex I0905 06:07:55.667277 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:55.667478 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:55.667513 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:55.667590 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:55.667619 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:55.667657 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:55.667686 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:55.667705 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:55.667731 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:55.667751 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:55.693565 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:07:55.697110 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:55.697201 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:56.742794 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:56.978554 20117 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0905 06:07:56.980987 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:56.981059 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:56.981136 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:56.984295 20117 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0905 06:07:56.989813 20117 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0905 06:07:56.990720 20117 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0905 06:07:56.990922 20117 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0905 06:07:56.991029 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:07:56.991126 20117 loadbalancers.go:35] PageSize not implemented I0905 06:07:56.991234 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:07:56.991316 20117 loadbalancers.go:35] PageSize not implemented I0905 06:07:56.997409 20117 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0905 06:07:56.997556 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:56.997746 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:56.997944 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:56.998366 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:56.998453 20117 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0905 06:07:56.998675 20117 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0905 06:07:56.998944 20117 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0905 06:07:57.005385 20117 target.go:111] Terraform output is in /tmp/test3587624636/out I0905 06:07:57.009805 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:57.009964 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:57.009995 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:57.010030 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:57.010060 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:57.010096 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:57.010126 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:57.010145 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:57.010172 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:57.010192 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:57.035346 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:07:57.038407 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:57.038470 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:57.634018 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:57.786803 20117 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0905 06:07:57.787849 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:57.787901 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:57.788021 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:57.790497 20117 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0905 06:07:57.793141 20117 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0905 06:07:57.793747 20117 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0905 06:07:57.793935 20117 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0905 06:07:57.793988 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:07:57.794043 20117 loadbalancers.go:35] PageSize not implemented I0905 06:07:57.794160 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:07:57.794236 20117 loadbalancers.go:35] PageSize not implemented I0905 06:07:57.798220 20117 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0905 06:07:57.798377 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:57.798565 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:57.798887 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:57.799211 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:57.799304 20117 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0905 06:07:57.799599 20117 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0905 06:07:57.799850 20117 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0905 06:07:57.806636 20117 target.go:111] Terraform output is in /tmp/test2350452737/out --- PASS: TestComplex (2.14s) === RUN TestCompress I0905 06:07:57.811258 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:57.811461 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:57.811497 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:57.811535 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:57.811568 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:57.811606 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:57.811639 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:57.811658 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:57.811686 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:57.811707 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:57.832973 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:07:57.835521 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:57.835577 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:58.435960 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:58.578882 20117 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0905 06:07:58.579348 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:58.579391 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:58.579475 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:58.581487 20117 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0905 06:07:58.585979 20117 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0905 06:07:58.586418 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:58.586616 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:58.587832 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:58.589223 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:58.589379 20117 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0905 06:07:58.590117 20117 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0905 06:07:58.590762 20117 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0905 06:07:58.630977 20117 target.go:111] Terraform output is in /tmp/test637019430/out --- PASS: TestCompress (0.82s) === RUN TestExternalPolicies I0905 06:07:58.635557 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:58.635763 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:58.635800 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:58.635841 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:58.635874 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:58.635913 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:58.635947 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:58.635966 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:58.635995 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:58.636018 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:58.658492 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:07:58.661519 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:58.661588 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:59.261151 20117 zones.go:93] ListHostedZonesPages { } I0905 06:07:59.405511 20117 executor.go:111] Tasks: 0 done / 115 total; 47 can run I0905 06:07:59.406024 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:07:59.406063 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:07:59.406151 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:07:59.411327 20117 executor.go:111] Tasks: 47 done / 115 total; 22 can run I0905 06:07:59.416772 20117 executor.go:111] Tasks: 69 done / 115 total; 30 can run I0905 06:07:59.417553 20117 executor.go:111] Tasks: 99 done / 115 total; 4 can run W0905 06:07:59.417600 20117 api.go:53] PageSize not implemented W0905 06:07:59.417629 20117 api.go:53] PageSize not implemented I0905 06:07:59.421881 20117 executor.go:111] Tasks: 103 done / 115 total; 4 can run I0905 06:07:59.422016 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:59.422241 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:59.422431 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:59.422854 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:59.422954 20117 executor.go:111] Tasks: 107 done / 115 total; 2 can run I0905 06:07:59.423211 20117 executor.go:111] Tasks: 109 done / 115 total; 6 can run I0905 06:07:59.423466 20117 executor.go:111] Tasks: 115 done / 115 total; 0 can run I0905 06:07:59.429630 20117 target.go:111] Terraform output is in /tmp/test2727291023/out --- PASS: TestExternalPolicies (0.80s) === RUN TestMinimalIPv6 I0905 06:07:59.434271 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:59.434465 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:59.434500 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:59.434536 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:59.434565 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:59.434601 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:59.434670 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:59.434689 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:59.434717 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:59.434739 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:59.457856 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:07:59.460917 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:07:59.460981 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:00.051502 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:00.203252 20117 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0905 06:08:00.207236 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:00.207274 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:00.207369 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:00.210485 20117 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0905 06:08:00.213056 20117 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0905 06:08:00.214029 20117 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0905 06:08:00.214420 20117 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0905 06:08:00.214483 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:08:00.214552 20117 loadbalancers.go:35] PageSize not implemented I0905 06:08:00.214647 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:08:00.214713 20117 loadbalancers.go:35] PageSize not implemented I0905 06:08:00.218629 20117 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0905 06:08:00.218763 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:00.218893 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:00.219166 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:00.219541 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:00.219642 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:08:00.219905 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:08:00.220156 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0905 06:08:00.226815 20117 target.go:111] Terraform output is in /tmp/test3983945506/out --- PASS: TestMinimalIPv6 (0.80s) === RUN TestMinimalIPv6Calico I0905 06:08:00.231657 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:00.231842 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:00.231878 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:00.231913 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:00.231943 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:00.231980 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:00.232047 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:00.232068 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:00.232098 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:00.232136 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:00.255053 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:08:00.257987 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:00.258048 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:00.850119 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:01.219644 20117 executor.go:111] Tasks: 0 done / 138 total; 47 can run I0905 06:08:01.220124 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:01.220155 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:01.220253 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:01.222725 20117 executor.go:111] Tasks: 47 done / 138 total; 25 can run I0905 06:08:01.225435 20117 executor.go:111] Tasks: 72 done / 138 total; 37 can run I0905 06:08:01.226099 20117 executor.go:111] Tasks: 109 done / 138 total; 9 can run I0905 06:08:01.226426 20117 executor.go:111] Tasks: 118 done / 138 total; 8 can run I0905 06:08:01.226543 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:08:01.226610 20117 loadbalancers.go:35] PageSize not implemented I0905 06:08:01.226700 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:08:01.226759 20117 loadbalancers.go:35] PageSize not implemented I0905 06:08:01.232437 20117 executor.go:111] Tasks: 126 done / 138 total; 4 can run I0905 06:08:01.232780 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:01.233110 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:01.234312 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:01.235070 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:01.236097 20117 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0905 06:08:01.236391 20117 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0905 06:08:01.236770 20117 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0905 06:08:01.244310 20117 target.go:111] Terraform output is in /tmp/test2305989190/out --- PASS: TestMinimalIPv6Calico (1.02s) === RUN TestMinimalIPv6Cilium I0905 06:08:01.250282 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:01.250500 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:01.250542 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:01.250648 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:01.250696 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:01.250760 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:01.250805 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:01.250845 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:01.250903 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:01.250935 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:01.274190 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:08:01.277478 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:01.277557 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:01.879952 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:02.037183 20117 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0905 06:08:02.037572 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:02.037603 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:02.037689 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:02.040781 20117 executor.go:111] Tasks: 47 done / 137 total; 25 can run I0905 06:08:02.043198 20117 executor.go:111] Tasks: 72 done / 137 total; 36 can run I0905 06:08:02.044366 20117 executor.go:111] Tasks: 108 done / 137 total; 9 can run I0905 06:08:02.044695 20117 executor.go:111] Tasks: 117 done / 137 total; 8 can run I0905 06:08:02.044757 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:08:02.044815 20117 loadbalancers.go:35] PageSize not implemented I0905 06:08:02.044910 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:08:02.044980 20117 loadbalancers.go:35] PageSize not implemented I0905 06:08:02.053397 20117 executor.go:111] Tasks: 125 done / 137 total; 4 can run I0905 06:08:02.053662 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:02.053885 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:02.054130 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:02.054480 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:02.054573 20117 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0905 06:08:02.054860 20117 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0905 06:08:02.055153 20117 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0905 06:08:02.062748 20117 target.go:111] Terraform output is in /tmp/test2408763128/out --- PASS: TestMinimalIPv6Cilium (0.82s) === RUN TestMinimalIPv6NoSubnetPrefix I0905 06:08:02.067847 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:02.068042 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:02.068078 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:02.068156 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:02.068187 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:02.068223 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:02.068256 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:02.068277 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:02.068306 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:02.068327 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:02.091145 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:08:02.094219 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:02.094284 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:02.761534 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:02.907753 20117 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0905 06:08:02.908683 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:02.908715 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:02.908814 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:02.910357 20117 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0905 06:08:02.912945 20117 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0905 06:08:02.913623 20117 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0905 06:08:02.913936 20117 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0905 06:08:02.914087 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:08:02.914171 20117 loadbalancers.go:35] PageSize not implemented I0905 06:08:02.914281 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:08:02.914345 20117 loadbalancers.go:35] PageSize not implemented I0905 06:08:02.918584 20117 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0905 06:08:02.918713 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:02.918896 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:02.919066 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:02.919466 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:02.919568 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:08:02.919817 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:08:02.920063 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0905 06:08:02.926522 20117 target.go:111] Terraform output is in /tmp/test3259271142/out --- PASS: TestMinimalIPv6NoSubnetPrefix (0.86s) === RUN TestMinimalWarmPool I0905 06:08:02.931290 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:02.931495 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:02.931530 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:02.931567 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:02.931597 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:02.931635 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:02.931669 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:02.931691 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:02.931719 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:02.931740 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:02.955231 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:02.958898 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:02.959025 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:03.559772 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:03.732463 20117 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0905 06:08:03.733487 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:03.733525 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:03.733645 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:03.735678 20117 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0905 06:08:03.740069 20117 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0905 06:08:03.740411 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:03.740568 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:03.740961 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:03.741035 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:03.741099 20117 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0905 06:08:03.741325 20117 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0905 06:08:03.741557 20117 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0905 06:08:03.747633 20117 target.go:111] Terraform output is in /tmp/test1564923927/out --- PASS: TestMinimalWarmPool (0.82s) === RUN TestMinimalEtcd I0905 06:08:03.752539 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:03.752735 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:03.752770 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:03.752808 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:03.752838 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:03.752921 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:03.752954 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:03.752975 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:03.753005 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:03.753026 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:03.773546 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:03.776233 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:03.776295 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:04.346235 20117 zones.go:93] ListHostedZonesPages { } W0905 06:08:04.655315 20117 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W0905 06:08:04.655351 20117 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W0905 06:08:04.657034 20117 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I0905 06:08:04.670165 20117 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0905 06:08:04.670867 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:04.670900 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:04.670972 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:04.673905 20117 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0905 06:08:04.678092 20117 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0905 06:08:04.678287 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:04.678522 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:04.678913 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:04.678976 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:04.679084 20117 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0905 06:08:04.679372 20117 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0905 06:08:04.679650 20117 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0905 06:08:04.685440 20117 target.go:111] Terraform output is in /tmp/test844912331/out --- PASS: TestMinimalEtcd (0.94s) === RUN TestMinimalGp3 I0905 06:08:04.690128 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:04.690326 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:04.690359 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:04.690393 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:04.690423 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:04.690461 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:04.690490 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:04.690511 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:04.690537 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:04.690557 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:04.710226 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:04.712903 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:04.712967 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:05.316973 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:05.455573 20117 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0905 06:08:05.457842 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:05.457883 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:05.458090 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:05.465171 20117 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0905 06:08:05.469583 20117 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0905 06:08:05.469772 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:05.470098 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:05.470350 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:05.470825 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:05.470931 20117 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0905 06:08:05.471196 20117 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0905 06:08:05.471496 20117 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0905 06:08:05.477595 20117 target.go:111] Terraform output is in /tmp/test258004832/out --- PASS: TestMinimalGp3 (0.79s) === RUN TestMinimalLongClusterName I0905 06:08:05.482373 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:05.482581 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:05.482617 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:05.482655 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:05.482686 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:05.482724 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:05.482757 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:05.482777 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:05.482806 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:05.482829 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:05.501679 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:05.504232 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:05.504292 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0905 06:08:06.086831 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:06.233820 20117 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0905 06:08:06.235590 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:06.235624 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:06.235703 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:06.238854 20117 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0905 06:08:06.246182 20117 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0905 06:08:06.246353 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:06.246575 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:06.246956 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:06.247030 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:06.247130 20117 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0905 06:08:06.247377 20117 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0905 06:08:06.247656 20117 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0905 06:08:06.253618 20117 target.go:111] Terraform output is in /tmp/test755963134/out --- PASS: TestMinimalLongClusterName (0.78s) === RUN TestExistingSG I0905 06:08:06.258400 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:06.258600 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:06.258650 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:06.258688 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:06.258738 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:06.258777 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:06.258831 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:06.258852 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:06.258884 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:06.258906 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:06.285083 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:06.288001 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:06.288063 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:06.288100 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:06.288133 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:06.893212 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:07.049033 20117 executor.go:111] Tasks: 0 done / 163 total; 53 can run I0905 06:08:07.054618 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:07.054678 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:07.055538 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:07.057866 20117 executor.go:111] Tasks: 53 done / 163 total; 26 can run I0905 06:08:07.060608 20117 executor.go:111] Tasks: 79 done / 163 total; 54 can run I0905 06:08:07.061510 20117 executor.go:111] Tasks: 133 done / 163 total; 6 can run W0905 06:08:07.061594 20117 api.go:53] PageSize not implemented W0905 06:08:07.061700 20117 api.go:53] PageSize not implemented W0905 06:08:07.061818 20117 api.go:53] PageSize not implemented W0905 06:08:07.061934 20117 api.go:53] PageSize not implemented I0905 06:08:07.066175 20117 executor.go:111] Tasks: 139 done / 163 total; 8 can run I0905 06:08:07.066334 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.066463 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.066668 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.066852 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.066929 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.067107 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.067256 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.067334 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.067415 20117 executor.go:111] Tasks: 147 done / 163 total; 4 can run I0905 06:08:07.067691 20117 executor.go:111] Tasks: 151 done / 163 total; 12 can run I0905 06:08:07.067968 20117 executor.go:111] Tasks: 163 done / 163 total; 0 can run I0905 06:08:07.076187 20117 target.go:111] Terraform output is in /tmp/test3533104885/out --- PASS: TestExistingSG (0.82s) === RUN TestBastionAdditionalUserData I0905 06:08:07.081957 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:07.082173 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:07.082210 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:07.082247 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:07.082277 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:07.082314 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:07.082346 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:07.082366 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:07.082395 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:07.082416 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:07.110870 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:07.113706 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.113776 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.113816 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.696266 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:07.846313 20117 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0905 06:08:07.847532 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:07.847575 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:07.847690 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:07.849492 20117 executor.go:111] Tasks: 47 done / 137 total; 30 can run I0905 06:08:07.852152 20117 executor.go:111] Tasks: 77 done / 137 total; 35 can run I0905 06:08:07.852974 20117 executor.go:111] Tasks: 112 done / 137 total; 6 can run W0905 06:08:07.853041 20117 api.go:53] PageSize not implemented W0905 06:08:07.853087 20117 api.go:53] PageSize not implemented W0905 06:08:07.853200 20117 api.go:53] PageSize not implemented I0905 06:08:07.857234 20117 executor.go:111] Tasks: 118 done / 137 total; 7 can run I0905 06:08:07.857409 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.857601 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.857810 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.858019 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.858255 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.858330 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.858416 20117 executor.go:111] Tasks: 125 done / 137 total; 3 can run I0905 06:08:07.858656 20117 executor.go:111] Tasks: 128 done / 137 total; 9 can run I0905 06:08:07.858981 20117 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0905 06:08:07.866413 20117 target.go:111] Terraform output is in /tmp/test1858896216/out --- PASS: TestBastionAdditionalUserData (0.79s) === RUN TestPrivateFlannel I0905 06:08:07.871709 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:07.871908 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:07.871943 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:07.871979 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:07.872008 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:07.872043 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:07.872111 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:07.872160 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:07.872189 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:07.872210 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:07.899200 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:08:07.901925 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.901991 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:07.902031 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:08.503597 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:08.662896 20117 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0905 06:08:08.663557 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:08.663589 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:08.663697 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:08.665397 20117 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0905 06:08:08.668135 20117 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0905 06:08:08.668736 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:08.668912 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:08.668999 20117 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0905 06:08:08.669080 20117 api.go:53] PageSize not implemented W0905 06:08:08.669216 20117 api.go:53] PageSize not implemented I0905 06:08:08.677524 20117 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0905 06:08:08.677793 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:08.678007 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:08.678246 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:08.678615 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:08.678712 20117 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0905 06:08:08.678967 20117 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0905 06:08:08.679212 20117 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0905 06:08:08.686473 20117 target.go:111] Terraform output is in /tmp/test2863900872/out --- PASS: TestPrivateFlannel (0.82s) === RUN TestPrivateCalico I0905 06:08:08.691568 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:08.691756 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:08.691790 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:08.691828 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:08.691858 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:08.691896 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:08.691967 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:08.691988 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:08.692015 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:08.692037 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:08.714257 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:08:08.717254 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:08.717315 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:08.717355 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:09.354839 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:09.712635 20117 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0905 06:08:09.712973 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:09.713028 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:09.713154 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:09.715220 20117 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0905 06:08:09.718014 20117 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0905 06:08:09.718830 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:09.719007 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:09.719174 20117 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0905 06:08:09.719298 20117 api.go:53] PageSize not implemented W0905 06:08:09.719401 20117 api.go:53] PageSize not implemented I0905 06:08:09.724621 20117 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0905 06:08:09.725518 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:09.726168 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:09.727243 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:09.727371 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:09.727485 20117 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0905 06:08:09.727716 20117 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0905 06:08:09.728066 20117 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0905 06:08:09.735904 20117 target.go:111] Terraform output is in /tmp/test1473598261/out --- PASS: TestPrivateCalico (1.05s) === RUN TestPrivateCilium I0905 06:08:09.742113 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:09.742343 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:09.742380 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:09.742421 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:09.742452 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:09.742492 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:09.742529 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:09.742550 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:09.742579 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:09.742601 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:09.765327 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:09.768376 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:09.768438 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:09.768478 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:10.359714 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:10.525813 20117 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0905 06:08:10.527010 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:10.527041 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:10.527110 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:10.528807 20117 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0905 06:08:10.535057 20117 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0905 06:08:10.536858 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:10.537047 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:10.537511 20117 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0905 06:08:10.537584 20117 api.go:53] PageSize not implemented W0905 06:08:10.537630 20117 api.go:53] PageSize not implemented I0905 06:08:10.541937 20117 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0905 06:08:10.542087 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:10.542297 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:10.542814 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:10.543042 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:10.543128 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:08:10.543337 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:08:10.543586 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0905 06:08:10.550424 20117 target.go:111] Terraform output is in /tmp/test2803058713/out --- PASS: TestPrivateCilium (0.81s) === RUN TestPrivateCilium2 I0905 06:08:10.555473 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:10.555661 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:10.555695 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:10.555731 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:10.555760 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:10.555795 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:10.555860 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:10.555880 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:10.555906 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:10.555925 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:10.578222 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:08:10.581243 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:10.581307 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:10.581345 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:11.184348 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:11.695723 20117 executor.go:111] Tasks: 0 done / 138 total; 50 can run I0905 06:08:11.698268 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:11.698296 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:11.698374 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:11.699189 20117 executor.go:111] Tasks: 50 done / 138 total; 30 can run I0905 06:08:11.702197 20117 executor.go:111] Tasks: 80 done / 138 total; 36 can run I0905 06:08:11.702518 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:11.702655 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:11.702867 20117 executor.go:111] Tasks: 116 done / 138 total; 6 can run W0905 06:08:11.702935 20117 api.go:53] PageSize not implemented W0905 06:08:11.703022 20117 api.go:53] PageSize not implemented I0905 06:08:11.707174 20117 executor.go:111] Tasks: 122 done / 138 total; 8 can run I0905 06:08:11.707408 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:11.707606 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:11.707797 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:11.708235 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:11.708327 20117 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0905 06:08:11.708554 20117 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0905 06:08:11.708860 20117 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0905 06:08:11.716987 20117 target.go:111] Terraform output is in /tmp/test3388150/out --- PASS: TestPrivateCilium2 (1.17s) === RUN TestPrivateCiliumAdvanced I0905 06:08:11.726427 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:11.726654 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:11.726697 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:11.726756 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:11.726802 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:11.726869 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:11.726913 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:11.726953 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:11.727006 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:11.727040 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:11.759711 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:11.762867 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:11.762940 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:11.762981 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:12.364385 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:12.543960 20117 executor.go:111] Tasks: 0 done / 142 total; 54 can run I0905 06:08:12.544845 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:12.544878 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:12.545025 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:12.547145 20117 executor.go:111] Tasks: 54 done / 142 total; 30 can run I0905 06:08:12.550067 20117 executor.go:111] Tasks: 84 done / 142 total; 36 can run I0905 06:08:12.550551 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:12.550684 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:12.550774 20117 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0905 06:08:12.550876 20117 api.go:53] PageSize not implemented W0905 06:08:12.550919 20117 api.go:53] PageSize not implemented I0905 06:08:12.555680 20117 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0905 06:08:12.555839 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:12.556024 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:12.556417 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:12.556495 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:12.556566 20117 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0905 06:08:12.556808 20117 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0905 06:08:12.557053 20117 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0905 06:08:12.564635 20117 target.go:111] Terraform output is in /tmp/test4252543847/out --- PASS: TestPrivateCiliumAdvanced (0.84s) === RUN TestPrivateCiliumENI I0905 06:08:12.570076 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:12.570281 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:12.570317 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:12.570354 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:12.570384 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:12.570424 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:12.570457 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:12.570478 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:12.570506 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:12.570528 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:12.592314 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:12.595211 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:12.595274 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:12.595315 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:13.201187 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:13.375715 20117 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0905 06:08:13.377372 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:13.377396 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:13.377486 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:13.380523 20117 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0905 06:08:13.383000 20117 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0905 06:08:13.383801 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:13.383933 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:13.384017 20117 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0905 06:08:13.384090 20117 api.go:53] PageSize not implemented W0905 06:08:13.384220 20117 api.go:53] PageSize not implemented I0905 06:08:13.392707 20117 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0905 06:08:13.392861 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:13.393029 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:13.393243 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:13.393919 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:13.394019 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:08:13.394265 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:08:13.394468 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0905 06:08:13.401753 20117 target.go:111] Terraform output is in /tmp/test652095463/out --- PASS: TestPrivateCiliumENI (0.84s) === RUN TestPrivateCanal I0905 06:08:13.406805 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:13.407032 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:13.407072 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:13.407121 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:13.407155 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:13.407212 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:13.407291 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:13.407314 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:13.407343 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:13.407370 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:13.428395 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:08:13.430995 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:13.431071 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:13.431111 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:14.020207 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:14.464520 20117 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0905 06:08:14.464891 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:14.464921 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:14.464977 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:14.467387 20117 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0905 06:08:14.469246 20117 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0905 06:08:14.469432 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:14.469570 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:14.469800 20117 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0905 06:08:14.469869 20117 api.go:53] PageSize not implemented W0905 06:08:14.469921 20117 api.go:53] PageSize not implemented I0905 06:08:14.472865 20117 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0905 06:08:14.472962 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:14.473095 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:14.473232 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:14.473726 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:14.473833 20117 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0905 06:08:14.474128 20117 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0905 06:08:14.474382 20117 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0905 06:08:14.481842 20117 target.go:111] Terraform output is in /tmp/test3418162612/out --- PASS: TestPrivateCanal (1.09s) === RUN TestPrivateKopeio I0905 06:08:14.492137 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:14.492361 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:14.492398 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:14.492441 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:14.492469 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:14.492506 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:14.492538 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:14.492558 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:14.492587 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:14.492608 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:14.517294 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:14.520155 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:14.520217 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:14.520255 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:15.120742 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:15.272107 20117 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0905 06:08:15.275038 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:15.275072 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:15.275318 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:15.279848 20117 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0905 06:08:15.282979 20117 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0905 06:08:15.283597 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:15.283779 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:15.283868 20117 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0905 06:08:15.283924 20117 api.go:53] PageSize not implemented W0905 06:08:15.284030 20117 api.go:53] PageSize not implemented I0905 06:08:15.288165 20117 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0905 06:08:15.288308 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:15.288472 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:15.288930 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:15.288983 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:15.289096 20117 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0905 06:08:15.289363 20117 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0905 06:08:15.289604 20117 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0905 06:08:15.296737 20117 target.go:111] Terraform output is in /tmp/test2964832732/out --- PASS: TestPrivateKopeio (0.81s) === RUN TestUnmanaged I0905 06:08:15.301811 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:15.302011 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:15.302046 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:15.302089 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:15.302139 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:15.302179 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:15.302209 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:15.302227 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:15.302255 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:15.302276 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:15.325334 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:15.328227 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:15.328286 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:15.328325 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:15.921584 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:16.071580 20117 executor.go:111] Tasks: 0 done / 126 total; 46 can run I0905 06:08:16.072864 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:16.072898 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:16.072971 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:16.074360 20117 executor.go:111] Tasks: 46 done / 126 total; 27 can run I0905 06:08:16.077921 20117 executor.go:111] Tasks: 73 done / 126 total; 33 can run I0905 06:08:16.081418 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.081882 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.081969 20117 executor.go:111] Tasks: 106 done / 126 total; 5 can run W0905 06:08:16.082153 20117 api.go:53] PageSize not implemented W0905 06:08:16.082310 20117 api.go:53] PageSize not implemented I0905 06:08:16.087310 20117 executor.go:111] Tasks: 111 done / 126 total; 7 can run I0905 06:08:16.087464 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.087775 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.087975 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.088422 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.088524 20117 executor.go:111] Tasks: 118 done / 126 total; 2 can run I0905 06:08:16.088832 20117 executor.go:111] Tasks: 120 done / 126 total; 6 can run I0905 06:08:16.089115 20117 executor.go:111] Tasks: 126 done / 126 total; 0 can run I0905 06:08:16.095864 20117 target.go:111] Terraform output is in /tmp/test2915085982/out --- PASS: TestUnmanaged (0.80s) === RUN TestPrivateSharedSubnet I0905 06:08:16.100743 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:16.100944 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:16.100980 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:16.101022 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:16.101059 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:16.101097 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:16.101128 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:16.101146 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:16.101176 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:16.101197 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:16.122724 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:16.125634 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.125702 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.125747 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.717938 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:16.864999 20117 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0905 06:08:16.866005 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:16.866035 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:16.866105 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:16.867537 20117 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0905 06:08:16.867684 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:08:16.870316 20117 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0905 06:08:16.870499 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.870614 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.870893 20117 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0905 06:08:16.871004 20117 api.go:53] PageSize not implemented W0905 06:08:16.871126 20117 api.go:53] PageSize not implemented I0905 06:08:16.875325 20117 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0905 06:08:16.875543 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.875773 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.876139 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.876214 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.876285 20117 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0905 06:08:16.876522 20117 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0905 06:08:16.876791 20117 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0905 06:08:16.883718 20117 target.go:111] Terraform output is in /tmp/test676461663/out --- PASS: TestPrivateSharedSubnet (0.79s) === RUN TestPrivateSharedIP I0905 06:08:16.892279 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:16.892508 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:16.892548 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:16.892597 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:16.892631 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:16.892690 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:16.892725 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:16.892743 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:16.892783 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:16.892805 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:16.915786 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:16.918653 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.918732 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:16.918778 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:17.497909 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:17.642914 20117 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0905 06:08:17.643419 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:17.643450 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:17.643555 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:17.646877 20117 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0905 06:08:17.648139 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:08:17.653704 20117 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0905 06:08:17.654388 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:17.654524 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:17.654904 20117 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0905 06:08:17.654999 20117 api.go:53] PageSize not implemented W0905 06:08:17.655133 20117 api.go:53] PageSize not implemented I0905 06:08:17.659266 20117 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0905 06:08:17.659449 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:17.659733 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:17.660175 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:17.660251 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:17.660320 20117 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0905 06:08:17.660539 20117 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0905 06:08:17.660782 20117 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0905 06:08:17.667476 20117 target.go:111] Terraform output is in /tmp/test2313976305/out --- PASS: TestPrivateSharedIP (0.78s) === RUN TestPrivateDns1 I0905 06:08:17.672378 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:17.672578 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:17.672614 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:17.672649 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:17.672678 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:17.672713 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:17.672750 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:17.672770 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:17.672799 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:17.672820 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0905 06:08:17.697326 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:17.697408 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:17.697453 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:18.482752 20117 executor.go:111] Tasks: 0 done / 135 total; 46 can run I0905 06:08:18.485376 20117 executor.go:111] Tasks: 46 done / 135 total; 28 can run I0905 06:08:18.485734 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I0905 06:08:18.485775 20117 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I0905 06:08:18.485845 20117 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I0905 06:08:18.485860 20117 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I0905 06:08:18.485966 20117 executor.go:111] Tasks: 74 done / 135 total; 39 can run I0905 06:08:18.486189 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:18.486397 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:18.488518 20117 executor.go:111] Tasks: 113 done / 135 total; 6 can run W0905 06:08:18.488585 20117 api.go:53] PageSize not implemented W0905 06:08:18.488678 20117 api.go:53] PageSize not implemented I0905 06:08:18.492841 20117 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0905 06:08:18.493136 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:18.493338 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:18.493519 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:18.493899 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:18.493990 20117 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0905 06:08:18.494220 20117 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0905 06:08:18.494468 20117 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0905 06:08:18.501499 20117 target.go:111] Terraform output is in /tmp/test1730317118/out --- PASS: TestPrivateDns1 (0.83s) === RUN TestPrivateDns2 I0905 06:08:18.506376 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:18.506580 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:18.506621 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:18.506662 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:18.506694 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:18.506732 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:18.506765 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:18.506786 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:18.506814 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:18.506838 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:18.535551 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:18.535628 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:18.535670 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:19.275931 20117 executor.go:111] Tasks: 0 done / 132 total; 45 can run I0905 06:08:19.279153 20117 executor.go:111] Tasks: 45 done / 132 total; 26 can run I0905 06:08:19.279533 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I0905 06:08:19.279545 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:08:19.279567 20117 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I0905 06:08:19.279666 20117 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I0905 06:08:19.279689 20117 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I0905 06:08:19.279767 20117 executor.go:111] Tasks: 71 done / 132 total; 39 can run I0905 06:08:19.280038 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:19.280236 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:19.282523 20117 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0905 06:08:19.282614 20117 api.go:53] PageSize not implemented W0905 06:08:19.282738 20117 api.go:53] PageSize not implemented I0905 06:08:19.286973 20117 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0905 06:08:19.287245 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:19.287464 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:19.287834 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:19.287921 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:19.288017 20117 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0905 06:08:19.288240 20117 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0905 06:08:19.288483 20117 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0905 06:08:19.295780 20117 target.go:111] Terraform output is in /tmp/test2434902014/out --- PASS: TestPrivateDns2 (0.80s) === RUN TestDiscoveryFeatureGate I0905 06:08:19.305078 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:19.305301 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:19.305336 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:19.305375 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:19.305406 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:19.305445 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:19.305536 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:19.305559 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:19.305587 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:19.305609 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:19.326500 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:08:19.329465 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:19.329533 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:19.910217 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:20.078714 20117 executor.go:111] Tasks: 0 done / 113 total; 52 can run I0905 06:08:20.083438 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:20.083503 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:20.083708 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:20.088913 20117 executor.go:111] Tasks: 52 done / 113 total; 28 can run I0905 06:08:20.093347 20117 executor.go:111] Tasks: 80 done / 113 total; 25 can run I0905 06:08:20.093886 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:20.094100 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:20.094272 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:20.094702 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:20.094788 20117 executor.go:111] Tasks: 105 done / 113 total; 2 can run I0905 06:08:20.095020 20117 executor.go:111] Tasks: 107 done / 113 total; 6 can run I0905 06:08:20.095251 20117 executor.go:111] Tasks: 113 done / 113 total; 0 can run I0905 06:08:20.101977 20117 target.go:111] Terraform output is in /tmp/test2031395710/out --- PASS: TestDiscoveryFeatureGate (0.80s) === RUN TestVFSServiceAccountIssuerDiscovery I0905 06:08:20.108009 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:20.108208 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:20.108245 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:20.108284 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:20.108314 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:20.108351 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:20.108383 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:20.108403 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:20.108432 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:20.108454 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:20.127947 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:20.130654 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:20.130720 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:20.731517 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:20.878725 20117 executor.go:111] Tasks: 0 done / 104 total; 47 can run I0905 06:08:20.882350 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:20.882393 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:20.882514 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:20.883621 20117 executor.go:111] Tasks: 47 done / 104 total; 24 can run I0905 06:08:20.891484 20117 executor.go:111] Tasks: 71 done / 104 total; 25 can run I0905 06:08:20.891804 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:20.892048 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:20.892388 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:20.892806 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:20.892902 20117 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0905 06:08:20.893196 20117 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0905 06:08:20.893463 20117 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0905 06:08:20.899759 20117 target.go:111] Terraform output is in /tmp/test1335918905/out --- PASS: TestVFSServiceAccountIssuerDiscovery (0.80s) === RUN TestAWSLBController I0905 06:08:20.904615 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:20.904810 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:20.904847 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:20.904886 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:20.904915 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:20.904952 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:20.904985 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:20.905008 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:20.905036 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:20.905060 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:20.925076 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:20.927831 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:20.927898 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:21.528687 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:22.108752 20117 executor.go:111] Tasks: 0 done / 116 total; 54 can run I0905 06:08:22.110417 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:22.110456 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:22.110541 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:22.111775 20117 executor.go:111] Tasks: 54 done / 116 total; 29 can run I0905 06:08:22.116461 20117 executor.go:111] Tasks: 83 done / 116 total; 25 can run I0905 06:08:22.116898 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:22.117113 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:22.117505 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:22.117588 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:22.117687 20117 executor.go:111] Tasks: 108 done / 116 total; 2 can run I0905 06:08:22.117974 20117 executor.go:111] Tasks: 110 done / 116 total; 6 can run I0905 06:08:22.118274 20117 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0905 06:08:22.126330 20117 target.go:111] Terraform output is in /tmp/test2843698436/out --- PASS: TestAWSLBController (1.24s) === RUN TestManyAddons I0905 06:08:22.141478 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:22.141694 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:22.141730 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:22.141769 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:22.141800 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:22.141838 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:22.141871 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:22.141891 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:22.141922 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:22.141944 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:22.166224 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:22.169138 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:22.169207 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:22.769910 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:23.386976 20117 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0905 06:08:23.388495 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:23.388529 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:23.388619 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:23.390736 20117 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0905 06:08:23.395197 20117 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0905 06:08:23.395491 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:23.395727 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:23.395966 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:23.396365 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:23.396458 20117 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0905 06:08:23.396680 20117 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0905 06:08:23.396950 20117 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0905 06:08:23.404604 20117 target.go:111] Terraform output is in /tmp/test1555089595/out --- PASS: TestManyAddons (1.28s) === RUN TestManyAddonsCCMIRSA I0905 06:08:23.418635 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:23.418967 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:23.419006 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:23.419048 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:23.419080 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:23.419126 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:23.419161 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:23.419180 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:23.419209 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:23.419231 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:23.440508 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:23.443609 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:23.443675 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:24.040180 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:24.725406 20117 executor.go:111] Tasks: 0 done / 123 total; 59 can run I0905 06:08:24.726016 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:24.726055 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:24.726135 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:24.729860 20117 executor.go:111] Tasks: 59 done / 123 total; 30 can run I0905 06:08:24.732715 20117 executor.go:111] Tasks: 89 done / 123 total; 26 can run I0905 06:08:24.732995 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:24.733190 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:24.733586 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:24.733662 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:24.733739 20117 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0905 06:08:24.733953 20117 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0905 06:08:24.734149 20117 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0905 06:08:24.747443 20117 target.go:111] Terraform output is in /tmp/test325042311/out --- PASS: TestManyAddonsCCMIRSA (1.34s) === RUN TestManyAddonsCCMIRSA23 I0905 06:08:24.757745 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:24.757938 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:24.757974 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:24.758012 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:24.758043 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:24.758082 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:24.758151 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:24.758172 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:24.758198 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:24.758219 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:24.779595 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0905 06:08:24.782155 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:24.782216 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:25.366338 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:26.054850 20117 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0905 06:08:26.055332 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:26.055376 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:26.055533 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:26.058662 20117 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0905 06:08:26.063339 20117 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0905 06:08:26.064390 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:26.064951 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:26.065957 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:26.066829 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:26.067055 20117 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0905 06:08:26.068630 20117 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0905 06:08:26.069717 20117 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0905 06:08:26.078912 20117 target.go:111] Terraform output is in /tmp/test1592688250/out --- PASS: TestManyAddonsCCMIRSA23 (1.33s) === RUN TestManyAddonsCCMIRSA24 I0905 06:08:26.088928 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:26.089138 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:26.089178 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:26.089240 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:26.089273 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:26.089315 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:26.089386 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:26.089406 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:26.089437 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:26.089458 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:26.110743 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:08:26.113459 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:26.113518 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:26.703428 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:27.405785 20117 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0905 06:08:27.409996 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:27.410050 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:27.410169 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:27.415313 20117 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0905 06:08:27.419614 20117 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0905 06:08:27.419833 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:27.419990 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:27.420416 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:27.420485 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:27.420571 20117 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0905 06:08:27.420775 20117 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0905 06:08:27.420965 20117 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0905 06:08:27.430063 20117 target.go:111] Terraform output is in /tmp/test3054888975/out --- PASS: TestManyAddonsCCMIRSA24 (1.35s) === RUN TestManyAddonsCCMIRSA25 I0905 06:08:27.440675 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:27.440874 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:27.440910 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:27.440948 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:27.440978 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:27.441015 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:27.441086 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:27.441106 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:27.441137 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:27.441159 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:27.470242 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0905 06:08:27.473252 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:27.473330 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:28.070668 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:28.780822 20117 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0905 06:08:28.781133 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:28.781167 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:28.781252 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:28.789222 20117 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0905 06:08:28.793262 20117 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0905 06:08:28.793530 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:28.793833 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:28.794164 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:28.794456 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:28.794551 20117 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0905 06:08:28.794846 20117 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0905 06:08:28.795130 20117 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0905 06:08:28.804387 20117 target.go:111] Terraform output is in /tmp/test620426610/out --- PASS: TestManyAddonsCCMIRSA25 (1.37s) === RUN TestManyAddonsCCMIRSA26 I0905 06:08:28.814752 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:28.814957 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:28.814994 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:28.815034 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:28.815067 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:28.815108 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:28.815179 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:28.815201 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:28.815230 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:28.815253 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:28.845150 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0905 06:08:28.848205 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:28.848275 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:29.449621 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:30.171892 20117 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0905 06:08:30.174030 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:30.174071 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:30.174145 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:30.177801 20117 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0905 06:08:30.181984 20117 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0905 06:08:30.182334 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:30.182528 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:30.182713 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:30.183059 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:30.183148 20117 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0905 06:08:30.183377 20117 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0905 06:08:30.183645 20117 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0905 06:08:30.192776 20117 target.go:111] Terraform output is in /tmp/test1132811096/out --- PASS: TestManyAddonsCCMIRSA26 (1.39s) === RUN TestManyAddonsGCE I0905 06:08:30.209057 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:08:31.592748 20117 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0905 06:08:31.592804 20117 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0905 06:08:31.592863 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W0905 06:08:31.592874 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W0905 06:08:31.592883 20117 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W0905 06:08:31.592923 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0905 06:08:31.593539 20117 executor.go:111] Tasks: 0 done / 67 total; 44 can run I0905 06:08:31.603545 20117 executor.go:111] Tasks: 44 done / 67 total; 17 can run I0905 06:08:31.608049 20117 executor.go:111] Tasks: 61 done / 67 total; 4 can run I0905 06:08:31.608852 20117 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0905 06:08:31.609021 20117 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0905 06:08:31.613600 20117 target.go:111] Terraform output is in /tmp/test699698486/out --- PASS: TestManyAddonsGCE (1.41s) === RUN TestCCM I0905 06:08:31.620421 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:31.620621 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:31.620658 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:31.620699 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:31.620731 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:31.620773 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:31.620807 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:31.620828 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:31.620856 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:31.620877 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:31.645129 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:31.650677 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:31.650755 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:32.244227 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:32.878355 20117 executor.go:111] Tasks: 0 done / 110 total; 51 can run I0905 06:08:32.878718 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:32.878759 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:32.878863 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:32.881349 20117 executor.go:111] Tasks: 51 done / 110 total; 24 can run I0905 06:08:32.885605 20117 executor.go:111] Tasks: 75 done / 110 total; 27 can run I0905 06:08:32.886005 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:32.886250 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:32.886549 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:32.886609 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:32.886701 20117 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0905 06:08:32.886899 20117 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0905 06:08:32.887137 20117 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0905 06:08:32.894101 20117 target.go:111] Terraform output is in /tmp/test3752072454/out --- PASS: TestCCM (1.29s) === RUN TestExternalDNS I0905 06:08:32.908676 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:32.908940 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:32.908985 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:32.909048 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:32.909098 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:32.909162 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:32.909205 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:32.909246 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:32.909297 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:32.909332 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:32.929461 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:32.932087 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:32.932187 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:33.524271 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:33.670198 20117 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0905 06:08:33.670650 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:33.670680 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:33.670784 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:33.672941 20117 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0905 06:08:33.677509 20117 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0905 06:08:33.677794 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:33.677911 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:33.678330 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:33.678379 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:33.678471 20117 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0905 06:08:33.678722 20117 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0905 06:08:33.679024 20117 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0905 06:08:33.684740 20117 target.go:111] Terraform output is in /tmp/test2674413108/out --- PASS: TestExternalDNS (0.78s) === RUN TestExternalDNSIRSA I0905 06:08:33.689456 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:33.689656 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:33.689695 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:33.689734 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:33.689763 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:33.689802 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:33.689835 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:33.689855 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:33.689885 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:33.689907 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:33.715205 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:33.718112 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:33.718183 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:34.299221 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:34.468387 20117 executor.go:111] Tasks: 0 done / 112 total; 51 can run I0905 06:08:34.468759 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:34.468821 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:34.468914 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:34.477520 20117 executor.go:111] Tasks: 51 done / 112 total; 28 can run I0905 06:08:34.481734 20117 executor.go:111] Tasks: 79 done / 112 total; 25 can run I0905 06:08:34.482198 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:34.482405 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:34.482615 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:34.482935 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:34.483013 20117 executor.go:111] Tasks: 104 done / 112 total; 2 can run I0905 06:08:34.483248 20117 executor.go:111] Tasks: 106 done / 112 total; 6 can run I0905 06:08:34.483491 20117 executor.go:111] Tasks: 112 done / 112 total; 0 can run I0905 06:08:34.490276 20117 target.go:111] Terraform output is in /tmp/test2461639128/out --- PASS: TestExternalDNSIRSA (0.81s) === RUN TestKarpenter I0905 06:08:34.496172 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:34.496370 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:34.496405 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:34.496444 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:34.496474 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:34.496511 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:34.496543 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:34.496564 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:34.496591 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:34.496612 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:34.521372 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:08:34.524747 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:34.524804 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:34.524846 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.115767 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:35.275187 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.275427 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.275739 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0905 06:08:35.394555 20117 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W0905 06:08:35.394629 20117 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0905 06:08:35.394644 20117 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W0905 06:08:35.394652 20117 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0905 06:08:35.394660 20117 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I0905 06:08:35.410901 20117 executor.go:111] Tasks: 0 done / 122 total; 54 can run I0905 06:08:35.411625 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:35.411656 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:35.411777 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:35.419210 20117 executor.go:111] Tasks: 54 done / 122 total; 31 can run I0905 06:08:35.424127 20117 executor.go:111] Tasks: 85 done / 122 total; 29 can run I0905 06:08:35.424380 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.424577 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.424802 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.425033 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.425269 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.425393 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.425486 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.425709 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.425812 20117 executor.go:111] Tasks: 114 done / 122 total; 2 can run I0905 06:08:35.426092 20117 executor.go:111] Tasks: 116 done / 122 total; 6 can run I0905 06:08:35.426345 20117 executor.go:111] Tasks: 122 done / 122 total; 0 can run I0905 06:08:35.434821 20117 target.go:111] Terraform output is in /tmp/test2156806622/out --- PASS: TestKarpenter (0.95s) === RUN TestSharedSubnet I0905 06:08:35.441863 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:35.442069 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:35.442104 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:35.442166 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:35.442197 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:35.442236 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:35.442272 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:35.442293 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:35.442322 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:35.442344 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:35.461390 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:35.463945 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:35.464009 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:36.065501 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:36.210380 20117 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0905 06:08:36.211802 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:36.211832 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:36.211918 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:36.212981 20117 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0905 06:08:36.213389 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:08:36.217342 20117 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0905 06:08:36.217533 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:36.219193 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:36.219871 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:36.220412 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:36.220556 20117 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0905 06:08:36.221345 20117 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0905 06:08:36.222884 20117 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0905 06:08:36.229310 20117 target.go:111] Terraform output is in /tmp/test3893043949/out --- PASS: TestSharedSubnet (0.79s) === RUN TestSharedVPC I0905 06:08:36.233996 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:36.234195 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:36.234232 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:36.234271 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:36.234303 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:36.234341 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:36.234373 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:36.234392 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:36.234421 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:36.234445 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:36.253486 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:36.256079 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:36.256143 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:36.846719 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:36.987537 20117 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0905 06:08:36.987908 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:36.987933 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:36.987993 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:36.994583 20117 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0905 06:08:36.995791 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:08:37.000068 20117 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0905 06:08:37.000246 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.000554 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.000752 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.001162 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.001255 20117 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0905 06:08:37.001509 20117 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0905 06:08:37.001766 20117 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0905 06:08:37.007366 20117 target.go:111] Terraform output is in /tmp/test3168306111/out --- PASS: TestSharedVPC (0.78s) === RUN TestSharedVPCIPv6 I0905 06:08:37.011940 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:37.012154 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:37.012192 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:37.012232 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:37.012266 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:37.012304 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:37.012374 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:37.012394 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:37.012423 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:37.012445 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:37.014068 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:08:37.014114 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:08:37.035629 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:08:37.035674 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0905 06:08:37.035750 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:08:37.039148 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.039215 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.639139 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:37.793379 20117 executor.go:111] Tasks: 0 done / 133 total; 45 can run I0905 06:08:37.794163 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:37.794208 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:37.794340 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:37.796566 20117 executor.go:111] Tasks: 45 done / 133 total; 29 can run I0905 06:08:37.797151 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:08:37.797263 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:08:37.799386 20117 executor.go:111] Tasks: 74 done / 133 total; 37 can run I0905 06:08:37.800110 20117 executor.go:111] Tasks: 111 done / 133 total; 6 can run I0905 06:08:37.800180 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:08:37.800241 20117 loadbalancers.go:35] PageSize not implemented I0905 06:08:37.800268 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:08:37.800336 20117 loadbalancers.go:35] PageSize not implemented I0905 06:08:37.808515 20117 executor.go:111] Tasks: 117 done / 133 total; 8 can run I0905 06:08:37.808804 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.809017 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.809394 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.809449 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.809538 20117 executor.go:111] Tasks: 125 done / 133 total; 2 can run I0905 06:08:37.809804 20117 executor.go:111] Tasks: 127 done / 133 total; 6 can run I0905 06:08:37.810129 20117 executor.go:111] Tasks: 133 done / 133 total; 0 can run I0905 06:08:37.817421 20117 target.go:111] Terraform output is in /tmp/test1158992398/out --- PASS: TestSharedVPCIPv6 (0.81s) === RUN TestExistingIAM I0905 06:08:37.822321 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:37.822521 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:37.822557 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:37.822600 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:37.822632 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:37.822670 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:37.822703 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:37.822722 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:37.822752 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:37.822774 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:37.847764 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:37.850292 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.850347 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.850378 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:37.850407 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:38.476016 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:38.721023 20117 executor.go:111] Tasks: 0 done / 117 total; 51 can run I0905 06:08:38.721286 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:38.721320 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:38.721433 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:38.723714 20117 executor.go:111] Tasks: 51 done / 117 total; 19 can run I0905 06:08:38.728287 20117 executor.go:111] Tasks: 70 done / 117 total; 31 can run I0905 06:08:38.728608 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:38.728816 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:38.729035 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:38.729252 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:38.729434 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:38.729512 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:38.729559 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:38.729616 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:38.729733 20117 executor.go:111] Tasks: 101 done / 117 total; 4 can run I0905 06:08:38.730081 20117 executor.go:111] Tasks: 105 done / 117 total; 12 can run I0905 06:08:38.730354 20117 executor.go:111] Tasks: 117 done / 117 total; 0 can run I0905 06:08:38.737734 20117 target.go:111] Terraform output is in /tmp/test1405550610/out --- PASS: TestExistingIAM (0.93s) === RUN TestPhaseNetwork I0905 06:08:38.748363 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:38.748584 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:38.748620 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:38.748658 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:38.748690 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:38.748728 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:38.748761 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:38.748799 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:38.748833 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:38.748856 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:38.771462 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:38.774665 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:38.774727 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:38.774767 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:39.376834 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:39.524786 20117 executor.go:111] Tasks: 0 done / 135 total; 47 can run I0905 06:08:39.525622 20117 executor.go:111] Tasks: 47 done / 135 total; 30 can run I0905 06:08:39.526036 20117 executor.go:111] Tasks: 77 done / 135 total; 36 can run I0905 06:08:39.526751 20117 executor.go:111] Tasks: 113 done / 135 total; 6 can run I0905 06:08:39.526938 20117 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0905 06:08:39.527202 20117 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0905 06:08:39.527284 20117 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0905 06:08:39.527329 20117 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0905 06:08:39.528485 20117 target.go:111] Terraform output is in /tmp/test43905860/out --- PASS: TestPhaseNetwork (0.78s) === RUN TestExternalLoadBalancer I0905 06:08:39.529183 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:39.529400 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:39.529436 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:39.529476 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:39.529509 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:39.529548 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:39.529595 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:39.529620 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:39.529648 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:39.529670 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:39.554851 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:39.557532 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:39.557613 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.157241 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:40.296944 20117 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0905 06:08:40.297905 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:40.297935 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:40.298022 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:40.300330 20117 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0905 06:08:40.304808 20117 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0905 06:08:40.305297 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.305552 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.305954 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.306013 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.306134 20117 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0905 06:08:40.306402 20117 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0905 06:08:40.306659 20117 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0905 06:08:40.312192 20117 target.go:111] Terraform output is in /tmp/test3249250563/out --- PASS: TestExternalLoadBalancer (0.79s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I0905 06:08:40.316940 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:40.317143 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:40.317177 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:40.317217 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:40.317250 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:40.317287 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:40.317320 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:40.317340 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:40.317368 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:40.317391 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:40.347697 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:40.350758 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.350828 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.350867 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.350904 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.350943 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.350977 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.351015 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:40.939737 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:41.089659 20117 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0905 06:08:41.090393 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:41.090427 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:41.090511 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:41.092841 20117 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0905 06:08:41.097480 20117 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0905 06:08:41.097736 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.099904 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.100294 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.100654 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.100918 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.102092 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.103116 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.103402 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.103518 20117 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0905 06:08:41.104752 20117 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0905 06:08:41.105079 20117 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0905 06:08:41.112791 20117 target.go:111] Terraform output is in /tmp/test877517659/out --- PASS: TestMixedInstancesASG (0.80s) === RUN TestMixedInstancesSpotASG I0905 06:08:41.118594 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:41.118812 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:41.118849 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:41.118888 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:41.118920 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:41.118957 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:41.118988 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:41.119009 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:41.119036 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:41.119056 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:41.144032 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:41.146538 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.146596 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.146628 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.146658 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.146685 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.146706 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.146730 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.739550 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:41.897305 20117 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0905 06:08:41.898950 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:41.898989 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:41.899079 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:41.901860 20117 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0905 06:08:41.906446 20117 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0905 06:08:41.906668 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.906891 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.907056 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.907133 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.907299 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.908300 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.908766 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.909151 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.909339 20117 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0905 06:08:41.910069 20117 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0905 06:08:41.911067 20117 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0905 06:08:41.920693 20117 target.go:111] Terraform output is in /tmp/test267457517/out --- PASS: TestMixedInstancesSpotASG (0.81s) === RUN TestAdditionalObjects I0905 06:08:41.926830 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:41.927023 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:41.927059 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:41.927098 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:41.927131 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:41.927170 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:41.927201 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:41.927223 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:41.927260 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:41.927282 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:41.947994 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0905 06:08:41.950710 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:41.950775 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:42.540984 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:42.676855 20117 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0905 06:08:42.683599 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:42.683645 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:42.683728 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:42.685305 20117 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0905 06:08:42.689766 20117 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0905 06:08:42.689962 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:42.690168 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:42.690316 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:42.690752 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:42.690842 20117 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0905 06:08:42.691065 20117 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0905 06:08:42.691305 20117 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0905 06:08:42.697131 20117 target.go:111] Terraform output is in /tmp/test4004014878/out --- PASS: TestAdditionalObjects (0.77s) === RUN TestContainerd I0905 06:08:42.701843 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:42.702039 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:42.702074 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:42.702111 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:42.702162 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:42.702200 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:42.702236 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:42.702254 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:42.702284 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:42.702307 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:42.722061 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:42.724658 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:42.724723 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:43.309865 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:43.455315 20117 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0905 06:08:43.455833 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:43.455866 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:43.455949 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:43.460721 20117 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0905 06:08:43.467018 20117 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0905 06:08:43.467364 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:43.467478 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:43.467750 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:43.468054 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:43.468143 20117 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0905 06:08:43.468334 20117 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0905 06:08:43.468584 20117 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0905 06:08:43.474433 20117 target.go:111] Terraform output is in /tmp/test1761542518/out --- PASS: TestContainerd (0.78s) === RUN TestContainerdCustom I0905 06:08:43.479106 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:43.479308 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:43.479345 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:43.479383 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:43.479412 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:43.479452 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:43.479484 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:43.479505 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:43.479533 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:43.479554 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:43.500048 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:43.502886 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:43.502952 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.023083 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:44.168818 20117 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0905 06:08:44.170688 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:44.170717 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:44.170789 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:44.172687 20117 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0905 06:08:44.177198 20117 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0905 06:08:44.177647 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.177856 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.178250 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.178332 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.178430 20117 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0905 06:08:44.178671 20117 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0905 06:08:44.178929 20117 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0905 06:08:44.184401 20117 target.go:111] Terraform output is in /tmp/test1282965808/out --- PASS: TestContainerdCustom (0.71s) === RUN TestDockerCustom I0905 06:08:44.189039 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:44.189240 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:44.189279 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:44.189319 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:44.189347 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:44.189387 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:44.189418 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:44.189438 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:44.189468 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:44.189489 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:44.209425 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0905 06:08:44.212327 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.212392 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.723023 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:44.863348 20117 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0905 06:08:44.863816 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:44.863849 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:44.863927 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:44.865825 20117 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0905 06:08:44.870112 20117 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0905 06:08:44.870544 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.870736 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.871095 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.871170 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.871238 20117 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0905 06:08:44.871567 20117 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0905 06:08:44.871816 20117 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0905 06:08:44.877237 20117 target.go:111] Terraform output is in /tmp/test1766053956/out --- PASS: TestDockerCustom (0.69s) === RUN TestAPIServerNodes I0905 06:08:44.881830 20117 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0905 06:08:44.881857 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:44.882059 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:44.882098 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:44.882165 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:44.882211 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:44.882252 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:44.882291 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:44.882314 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:44.882342 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:44.882369 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:44.903278 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0905 06:08:44.905765 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.905878 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:44.905924 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:45.561639 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:45.711100 20117 executor.go:111] Tasks: 0 done / 114 total; 47 can run I0905 06:08:45.714469 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:45.714501 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:45.714577 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:45.715915 20117 executor.go:111] Tasks: 47 done / 114 total; 28 can run I0905 06:08:45.723697 20117 executor.go:111] Tasks: 75 done / 114 total; 27 can run I0905 06:08:45.724381 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:45.725024 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:45.725873 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:45.726269 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:45.726359 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:45.726593 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:45.727385 20117 executor.go:111] Tasks: 102 done / 114 total; 3 can run I0905 06:08:45.727663 20117 executor.go:111] Tasks: 105 done / 114 total; 9 can run I0905 06:08:45.727969 20117 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0905 06:08:45.734346 20117 target.go:111] Terraform output is in /tmp/test3445880987/out I0905 06:08:45.739423 20117 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (0.86s) === RUN TestNTHIMDSProcessor I0905 06:08:45.739535 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:45.739731 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:45.739767 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:45.739807 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:45.739837 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:45.739876 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:45.739910 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:45.739930 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:45.739957 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:45.739978 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:45.759383 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:45.762009 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:45.762073 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:46.353228 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:46.500958 20117 executor.go:111] Tasks: 0 done / 90 total; 44 can run I0905 06:08:46.502019 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:46.502047 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:46.502146 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:46.504044 20117 executor.go:111] Tasks: 44 done / 90 total; 19 can run I0905 06:08:46.508441 20117 executor.go:111] Tasks: 63 done / 90 total; 21 can run I0905 06:08:46.508721 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:46.509004 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:46.509417 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:46.509502 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:46.509605 20117 executor.go:111] Tasks: 84 done / 90 total; 2 can run I0905 06:08:46.509828 20117 executor.go:111] Tasks: 86 done / 90 total; 4 can run I0905 06:08:46.510013 20117 executor.go:111] Tasks: 90 done / 90 total; 0 can run I0905 06:08:46.515054 20117 target.go:111] Terraform output is in /tmp/test1358380588/out --- PASS: TestNTHIMDSProcessor (0.78s) === RUN TestNTHIMDSProcessorIRSA I0905 06:08:46.519224 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:46.519422 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:46.519458 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:46.519499 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:46.519529 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:46.519571 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:46.519605 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:46.519625 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:46.519655 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:46.519676 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:46.540151 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:46.542924 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:46.542984 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:47.146318 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:47.315078 20117 executor.go:111] Tasks: 0 done / 101 total; 50 can run I0905 06:08:47.315545 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:47.315579 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:47.316689 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:47.325133 20117 executor.go:111] Tasks: 50 done / 101 total; 24 can run I0905 06:08:47.329843 20117 executor.go:111] Tasks: 74 done / 101 total; 21 can run I0905 06:08:47.330195 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:47.330396 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:47.330581 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:47.331072 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:47.331157 20117 executor.go:111] Tasks: 95 done / 101 total; 2 can run I0905 06:08:47.331397 20117 executor.go:111] Tasks: 97 done / 101 total; 4 can run I0905 06:08:47.331546 20117 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0905 06:08:47.337969 20117 target.go:111] Terraform output is in /tmp/test3624929464/out --- PASS: TestNTHIMDSProcessorIRSA (0.82s) === RUN TestCustomIRSA I0905 06:08:47.343428 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:47.343630 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:47.343667 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:47.343702 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:47.343733 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:47.343772 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:47.343806 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:47.343825 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:47.343852 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:47.343873 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:47.366257 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:47.369492 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:47.369576 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:47.972410 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:48.516048 20117 executor.go:111] Tasks: 0 done / 114 total; 52 can run I0905 06:08:48.516825 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:48.516873 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:48.516970 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:48.519433 20117 executor.go:111] Tasks: 52 done / 114 total; 29 can run I0905 06:08:48.529073 20117 executor.go:111] Tasks: 81 done / 114 total; 25 can run I0905 06:08:48.529384 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:48.529725 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:48.529951 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:48.530137 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:48.530244 20117 executor.go:111] Tasks: 106 done / 114 total; 2 can run I0905 06:08:48.530479 20117 executor.go:111] Tasks: 108 done / 114 total; 6 can run I0905 06:08:48.530730 20117 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0905 06:08:48.538170 20117 target.go:111] Terraform output is in /tmp/test703052956/out --- PASS: TestCustomIRSA (1.20s) === RUN TestClusterNameDigit I0905 06:08:48.547951 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:48.548150 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:48.548186 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:48.548225 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:48.548260 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:48.548299 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:48.548334 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:48.548355 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:48.548411 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:48.548435 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:48.569587 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:08:48.572286 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:48.572345 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:49.164140 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:49.314356 20117 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0905 06:08:49.315838 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:49.315878 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:49.315960 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:49.317558 20117 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0905 06:08:49.323717 20117 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0905 06:08:49.324342 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:49.324612 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:49.325129 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:49.325227 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:49.325338 20117 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0905 06:08:49.325609 20117 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0905 06:08:49.325871 20117 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0905 06:08:49.331697 20117 target.go:111] Terraform output is in /tmp/test3162685888/out --- PASS: TestClusterNameDigit (0.79s) === RUN TestCASPriorityExpander I0905 06:08:49.336736 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:49.336927 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:49.336962 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:49.337002 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:49.337029 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:49.337066 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:49.337096 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:49.337116 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:49.337146 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:49.337168 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:49.365515 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0905 06:08:49.368436 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:49.368502 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:49.368539 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:49.368570 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0905 06:08:50.350262 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:50.514412 20117 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0905 06:08:50.515957 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:50.515988 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:50.516066 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:50.517530 20117 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0905 06:08:50.523041 20117 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0905 06:08:50.523940 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:50.524151 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:50.524348 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:50.524542 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:50.524616 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:50.524736 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:50.524947 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:50.525018 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:50.525090 20117 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0905 06:08:50.525504 20117 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0905 06:08:50.525852 20117 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0905 06:08:50.532549 20117 target.go:111] Terraform output is in /tmp/test2775796299/out --- PASS: TestCASPriorityExpander (1.20s) === RUN TestCASPriorityExpanderCustom I0905 06:08:50.537954 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:50.538149 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:50.538182 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:50.538220 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:50.538248 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:50.538282 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:50.538315 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:50.538336 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:50.538362 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:50.538382 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:08:50.562774 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0905 06:08:50.565883 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:50.565948 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:50.566001 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:50.566034 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0905 06:08:51.163808 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:51.324651 20117 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0905 06:08:51.326723 20117 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0905 06:08:51.326758 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:51.326831 20117 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0905 06:08:51.328607 20117 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0905 06:08:51.332913 20117 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0905 06:08:51.333275 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:51.333494 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:51.333619 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:51.333718 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:51.333942 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:51.334113 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:51.334175 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:51.334240 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:51.334312 20117 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0905 06:08:51.334595 20117 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0905 06:08:51.334918 20117 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0905 06:08:51.347103 20117 target.go:111] Terraform output is in /tmp/test4115181736/out --- PASS: TestCASPriorityExpanderCustom (0.81s) === RUN TestLifecycleMinimalAWS I0905 06:08:51.352895 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:08:51.353094 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:08:51.353131 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:08:51.353172 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:08:51.353202 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:08:51.353240 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:08:51.353271 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:08:51.353291 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:08:51.353320 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:08:51.353343 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0905 06:08:51.371718 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0905 06:08:51.374209 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:51.374277 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0905 06:08:52.015282 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:52.246250 20117 iamrole.go:89] ListRoles: { } I0905 06:08:52.247339 20117 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0905 06:08:52.247876 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:52.247966 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0905 06:08:52.248043 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:08:52.248109 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0905 06:08:52.248273 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:52.248430 20117 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I0905 06:08:52.248472 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:52.248691 20117 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:08:52.248896 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0905 06:08:52.248936 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0905 06:08:52.248970 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:08:52.249131 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:08:52.249189 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:08:52.249230 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:08:52.249264 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0905 06:08:52.249335 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" }] } I0905 06:08:52.249331 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:52.249496 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:08:52.249605 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:08:52.249647 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:52.249794 20117 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:08:52.249871 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:08:52.251480 20117 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0905 06:08:52.251603 20117 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0905 06:08:52.251568 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0905 06:08:52.251651 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:52.251764 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0905 06:08:52.251790 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0905 06:08:52.251872 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0905 06:08:52.251924 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0905 06:08:52.251973 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:52.252086 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0905 06:08:52.252159 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0905 06:08:52.252231 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0905 06:08:52.252255 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:52.252461 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:08:52.252456 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:08:52.252564 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:08:52.252606 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:08:52.252636 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:08:52.252682 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:08:52.252715 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:08:52.252834 20117 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0905 06:08:52.252875 20117 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:08:52.252940 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }], VpcId: "vpc-1" } I0905 06:08:52.253001 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:08:52.253033 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:08:52.253064 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:08:52.253096 20117 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] } I0905 06:08:52.253150 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:08:52.253214 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:08:52.253327 20117 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0905 06:08:52.253370 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0905 06:08:52.254529 20117 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0905 06:08:52.254716 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:08:52.254858 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:08:52.255035 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0905 06:08:52.255174 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0905 06:08:52.255319 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:08:52.255414 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0905 06:08:52.255477 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0905 06:08:52.255602 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:08:52.255767 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" }] }] } I0905 06:08:52.255923 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:08:52.256031 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:52.256127 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:08:52.256195 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:08:52.256296 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:08:52.256394 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:52.256525 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" }] }] } I0905 06:08:52.256704 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:52.256800 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:52.256881 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" }] }] } I0905 06:08:52.257011 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:08:52.257122 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:08:52.257221 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0905 06:08:52.257318 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:08:52.257411 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0905 06:08:52.257446 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0905 06:08:52.257566 20117 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0905 06:08:52.257798 20117 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0905 06:08:52.258012 20117 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0905 06:08:52.258056 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:52.258089 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:08:52.258150 20117 dns.go:235] Pre-creating DNS records I0905 06:08:52.258179 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:08:52.262546 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0905 06:08:52.265152 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:52.265239 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0905 06:08:52.921334 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:53.150339 20117 iamrole.go:89] ListRoles: { } I0905 06:08:53.151347 20117 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0905 06:08:53.151688 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.151882 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:08:53.152287 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.152679 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.152928 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.153013 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:08:53.153045 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:08:53.153082 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:08:53.153216 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:08:53.154589 20117 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0905 06:08:53.154701 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.154863 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0905 06:08:53.154822 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.154927 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:08:53.154980 20117 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0905 06:08:53.154999 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.155098 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:08:53.155124 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:08:53.155188 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0905 06:08:53.155313 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:08:53.155366 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0905 06:08:53.155562 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:08:53.158908 20117 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0905 06:08:53.159045 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:08:53.159228 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:53.159354 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:53.159406 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:08:53.159526 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:08:53.159628 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:53.159760 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:08:53.160346 20117 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0905 06:08:53.160526 20117 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0905 06:08:53.160736 20117 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0905 06:08:53.162804 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0905 06:08:53.162858 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:08:53.162886 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0905 06:08:53.162907 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:08:53.162927 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0905 06:08:53.162948 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0905 06:08:53.162969 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:08:53.163000 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0905 06:08:53.163022 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0905 06:08:53.163046 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0905 06:08:53.163073 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:08:53.163097 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:08:53.163115 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:08:53.163137 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0905 06:08:53.163155 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:08:53.163179 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:08:53.163200 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:08:53.163224 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:08:53.163244 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:08:53.163263 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0905 06:08:53.163281 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:08:53.163303 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:08:53.163329 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:08:53.163351 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0905 06:08:53.164299 20117 delete_cluster.go:128] Looking for cloud resources to delete W0905 06:08:53.164381 20117 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0905 06:08:53.164396 20117 keypairs.go:95] DescribeKeyPairs: { } I0905 06:08:53.164428 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.164465 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0905 06:08:53.164506 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.164554 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.164587 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.164627 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.164658 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.164687 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0905 06:08:53.164720 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.164757 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:08:53.164786 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0905 06:08:53.164817 20117 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0905 06:08:53.164845 20117 api.go:53] PageSize not implemented I0905 06:08:53.164862 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:08:53.164883 20117 loadbalancers.go:35] PageSize not implemented I0905 06:08:53.164899 20117 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0905 06:08:53.164920 20117 targetgroups.go:35] PageSize not implemented I0905 06:08:53.164935 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0905 06:08:53.164977 20117 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0905 06:08:53.165017 20117 iamrole.go:89] ListRoles: { } I0905 06:08:53.165056 20117 zones.go:93] ListHostedZonesPages { } I0905 06:08:53.165079 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:08:53.165115 20117 internetgateways.go:101] DescribeInternetGateways: { } I0905 06:08:53.165149 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:08:53.165180 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:08:53.165573 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok autoscaling-group:nodes.minimal.example.com ok I0905 06:08:53.165648 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:08:53.165670 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0905 06:08:53.165751 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0905 06:08:53.165796 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0905 06:08:53.165832 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0905 06:08:53.165716 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0905 06:08:53.165860 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:08:53.165885 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0905 06:08:53.165751 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-config:lt-1 ok route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.minimal.example.com. ok I0905 06:08:53.165937 20117 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0905 06:08:53.166003 20117 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-2 ok I0905 06:08:53.166048 20117 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0905 06:08:53.166106 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0905 06:08:53.166150 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:08:53.166186 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0905 06:08:53.166337 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:08:53.166349 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0905 06:08:53.166418 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0905 06:08:53.166437 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0905 06:08:53.166491 20117 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0905 06:08:53.166504 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0905 06:08:53.166533 20117 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0905 06:08:53.166559 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0905 06:08:53.166589 20117 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0905 06:08:53.166598 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0905 06:08:53.166616 20117 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0905 06:08:53.166684 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0905 06:08:53.166755 20117 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0905 06:08:53.166820 20117 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (1.81s) === RUN TestLifecycleMinimalOpenstack I0905 06:08:53.167338 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I0905 06:08:53.173785 20117 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:08:53.878492 20117 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0905 06:08:53.878525 20117 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0905 06:08:53.891960 20117 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/09/05 06:08:53 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:08:53 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0905 06:08:53.899232 20117 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0905 06:08:53.957418 20117 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0905 06:08:53.960666 20117 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/09/05 06:08:53 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:08:53 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:08:53 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0905 06:08:53.964970 20117 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0905 06:08:53.965040 20117 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0905 06:08:53.965692 20117 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0905 06:08:54.973379 20117 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:08:55.689258 20117 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0905 06:08:55.689294 20117 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0905 06:08:55.704912 20117 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/09/05 06:08:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:08:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0905 06:08:55.708818 20117 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0905 06:08:55.721412 20117 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0905 06:08:55.722760 20117 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/09/05 06:08:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:08:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:08:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0905 06:08:55.725328 20117 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0905 06:08:55.725503 20117 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0905 06:08:55.725762 20117 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0905 06:08:55.726065 20117 executor.go:111] Tasks: 92 done / 92 total; 0 can run I0905 06:08:55.727277 20117 delete_cluster.go:128] Looking for cloud resources to delete 2025/09/05 06:08:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) SecurityGroup:362b64da-a9bf-42ce-9534-01cce69a0bd2 ok SecurityGroup:0ce90cde-b525-42f0-9f34-1e5ecfa35874 ok Instance:4c1f1430-0ac0-4927-b3f0-9d2dcc712eeb ok Instance:63ba4eda-39d9-407f-9b1f-1b91614ff705 ok Subnet:bf1c3f16-8245-4d13-b9b3-6fb1dff3f91e ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Port:553f9117-17be-4e70-a857-58da7c54e05d ok Network:1f2c0681-8f0f-4e80-b6d0-2959eaf04a8b ok ServerGroup:806d9eb8-2a69-4bea-9e0c-1aae1ddcc5fa ok SecurityGroup:6643a137-d54c-413f-bac6-f33f1436ad94 ok ServerGroup:c30a717e-99c7-4708-b575-cd741229df01 ok Port:51f0dfb7-df32-4b88-8d88-536090b4b400 ok Port:018a7e17-c497-4137-b78f-a70c50155912 ok Instance:54c8b3ad-2421-4d0a-abd9-8b86cd2abf5b ok --- PASS: TestLifecycleMinimalOpenstack (3.67s) === RUN TestLifecycleMinimalGCE I0905 06:08:56.838939 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I0905 06:08:56.840504 20117 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:08:57.821137 20117 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0905 06:08:57.821222 20117 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0905 06:08:57.821323 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0905 06:08:57.821342 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0905 06:08:57.821362 20117 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0905 06:08:57.821422 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0905 06:08:57.822613 20117 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0905 06:08:57.825312 20117 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0905 06:08:57.829493 20117 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0905 06:08:57.830266 20117 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0905 06:08:57.830448 20117 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0905 06:08:57.830531 20117 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:08:58.841104 20117 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0905 06:08:58.841187 20117 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0905 06:08:58.841276 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0905 06:08:58.841299 20117 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0905 06:08:58.841318 20117 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0905 06:08:58.841374 20117 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0905 06:08:58.842477 20117 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0905 06:08:58.845019 20117 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0905 06:08:58.849372 20117 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0905 06:08:58.850185 20117 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0905 06:08:58.850322 20117 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0905 06:08:58.851571 20117 delete_cluster.go:128] Looking for cloud resources to delete I0905 06:08:58.851637 20117 gce.go:99] Scanning zones: [us-test1-a] I0905 06:08:58.851920 20117 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I0905 06:08:58.851938 20117 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:ssh-external-to-master-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:node-to-node-minimal-gce-example-com ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1757052537 ok InstanceTemplate:nodes-minimal-gce-example-com-1757052537 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (2.01s) === RUN TestLifecycleFloatingIPOpenstack I0905 06:08:58.853337 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I0905 06:08:58.859725 20117 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:08:59.592399 20117 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0905 06:08:59.592435 20117 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0905 06:08:59.605491 20117 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/09/05 06:08:59 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:08:59 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0905 06:08:59.610357 20117 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0905 06:08:59.623779 20117 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0905 06:08:59.625956 20117 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/09/05 06:08:59 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:08:59 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:08:59 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0905 06:08:59.627728 20117 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0905 06:08:59.627853 20117 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0905 06:08:59.627887 20117 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0905 06:09:00.631540 20117 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0905 06:09:01.345347 20117 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0905 06:09:01.345384 20117 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0905 06:09:01.361502 20117 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/09/05 06:09:01 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:09:01 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0905 06:09:01.366368 20117 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0905 06:09:01.376633 20117 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0905 06:09:01.378259 20117 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/09/05 06:09:01 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:09:01 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/09/05 06:09:01 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0905 06:09:01.380619 20117 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0905 06:09:01.381229 20117 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0905 06:09:01.381541 20117 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0905 06:09:01.382845 20117 delete_cluster.go:128] Looking for cloud resources to delete 2025/09/05 06:09:01 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) ServerGroup:6867b31e-f095-49f8-8e14-d4c11fdd9635 ok SecurityGroup:a7887e88-c336-4625-9a90-588ff1db4098 ok Port:082e2b7a-342d-479c-aea1-a2208707e091 ok Port:773d0b54-53fa-4620-b4e8-479b41a25e1d ok Network:01081dca-0fa6-4af7-bf3b-b7bac7c77355 ok SecurityGroup:1d9538e6-cb1f-439c-9890-b1fe1af90754 ok Instance:45b7bccf-0188-4059-ac6a-d2c04473f1c6 ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Router-IF:7c46b240-f752-417a-8285-82070293ae32 ok ServerGroup:1ec5f4c6-9137-49d4-aaa4-4856e30cb174 ok Instance:73ba979a-3664-4f63-a05d-716b84ba0c2a ok Router:61fab1d7-968f-4587-96a3-4c26285b0631 ok Port:6d087dea-9ad2-404c-b158-1c295e7180d4 ok Subnet:7c46b240-f752-417a-8285-82070293ae32 ok Port:7581862a-6007-4147-b5fb-c1c6130f48ae ok SecurityGroup:bec44f1b-4541-40bb-b04e-a3b9909532fc ok Instance:9f8d3190-a461-4561-8f85-9c42d261ce0c ok --- PASS: TestLifecycleFloatingIPOpenstack (3.64s) === RUN TestLifecyclePrivateCalico I0905 06:09:02.490818 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:09:02.491056 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:09:02.491097 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:09:02.491138 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:09:02.491169 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:09:02.491211 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:09:02.491243 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:09:02.491263 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:09:02.491292 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:09:02.491314 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I0905 06:09:02.519488 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:09:02.522515 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:02.522589 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:02.522628 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:03.128675 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:03.471103 20117 iamrole.go:89] ListRoles: { } I0905 06:09:03.472125 20117 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0905 06:09:03.472350 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:03.472712 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:03.472732 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0905 06:09:03.472878 20117 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.472887 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0905 06:09:03.472946 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:03.473009 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0905 06:09:03.473125 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0905 06:09:03.473118 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:03.473233 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:03.473296 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0905 06:09:03.473325 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0905 06:09:03.473349 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:03.473304 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I0905 06:09:03.473383 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:03.473410 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:03.473412 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0905 06:09:03.473508 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:03.473572 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:03.473598 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:03.473685 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:03.473813 20117 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.475874 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:09:03.475993 20117 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.478344 20117 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0905 06:09:03.478482 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0905 06:09:03.478652 20117 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0905 06:09:03.478736 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0905 06:09:03.478690 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:03.478768 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0905 06:09:03.478772 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0905 06:09:03.478827 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:03.478904 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:03.478954 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:03.479620 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0905 06:09:03.479578 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0905 06:09:03.478931 20117 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0905 06:09:03.479744 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:03.479788 20117 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0905 06:09:03.479702 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0905 06:09:03.479857 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0905 06:09:03.479947 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0905 06:09:03.479942 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:03.480010 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0905 06:09:03.480044 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:03.480077 20117 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0905 06:09:03.480080 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0905 06:09:03.480186 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0905 06:09:03.480261 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:03.480264 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0905 06:09:03.480341 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:03.480384 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:03.480417 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:03.480506 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0905 06:09:03.480551 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:03.480582 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:03.480735 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:09:03.480747 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:03.480905 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:03.481067 20117 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.481124 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:03.481202 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:03.481272 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:03.481298 20117 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0905 06:09:03.481091 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0905 06:09:03.481277 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:09:03.481354 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:03.481392 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:03.481425 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0905 06:09:03.481452 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:03.481475 20117 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0905 06:09:03.481506 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0905 06:09:03.481592 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0905 06:09:03.481623 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:03.481692 20117 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0905 06:09:03.481762 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:03.481801 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0905 06:09:03.481828 20117 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0905 06:09:03.481918 20117 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0905 06:09:03.482042 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" }] }] } W0905 06:09:03.482284 20117 api.go:53] PageSize not implemented I0905 06:09:03.482206 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" }] }] } I0905 06:09:03.482277 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:03.482504 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:03.482471 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:03.482522 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0905 06:09:03.482647 20117 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0905 06:09:03.482730 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:03.482680 20117 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I0905 06:09:03.482763 20117 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0905 06:09:03.482716 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:03.482884 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:03.482842 20117 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0905 06:09:03.482958 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:03.483191 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0905 06:09:03.483295 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:03.483370 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:03.483429 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:03.483482 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:03.483541 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:03.483587 20117 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } I0905 06:09:03.483609 20117 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } W0905 06:09:03.483665 20117 api.go:53] PageSize not implemented I0905 06:09:03.483586 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0905 06:09:03.483701 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:03.483760 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0905 06:09:03.483807 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0905 06:09:03.483937 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.484032 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" }] }] } I0905 06:09:03.484120 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.484220 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" }] }] } I0905 06:09:03.484370 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.484537 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" }] }] } I0905 06:09:03.484658 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0905 06:09:03.484729 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.484824 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.484920 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0905 06:09:03.484989 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0905 06:09:03.485061 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.485151 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0905 06:09:03.485193 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0905 06:09:03.485288 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0905 06:09:03.485352 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0905 06:09:03.485440 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0905 06:09:03.485562 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0905 06:09:03.485653 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.485743 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0905 06:09:03.485828 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0905 06:09:03.485896 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.485983 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0905 06:09:03.486020 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0905 06:09:03.486052 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0905 06:09:03.486078 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0905 06:09:03.486170 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.486263 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.486403 20117 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0905 06:09:03.486439 20117 api.go:53] PageSize not implemented I0905 06:09:03.486482 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:03.486506 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:03.486558 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:03.486571 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:03.486679 20117 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } W0905 06:09:03.486643 20117 api.go:53] PageSize not implemented I0905 06:09:03.486749 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:03.486613 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:03.486807 20117 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0905 06:09:03.486933 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0905 06:09:03.486846 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:03.486988 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:03.487040 20117 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0905 06:09:03.490947 20117 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0905 06:09:03.491028 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:03.491155 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0905 06:09:03.491254 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:03.491339 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:03.491489 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:03.491594 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:03.492180 20117 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0905 06:09:03.492379 20117 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0905 06:09:03.492565 20117 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0905 06:09:03.492609 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:03.492638 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:03.492691 20117 dns.go:235] Pre-creating DNS records I0905 06:09:03.492712 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:03.497820 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:09:03.500787 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:03.500851 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:03.500889 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:04.094851 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:04.461747 20117 iamrole.go:89] ListRoles: { } I0905 06:09:04.463001 20117 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0905 06:09:04.463528 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.463741 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:04.463889 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:04.464041 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.464135 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:04.464156 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:04.464197 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:04.464278 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] }] } I0905 06:09:04.464550 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.465902 20117 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0905 06:09:04.466106 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0905 06:09:04.466077 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:04.466188 20117 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0905 06:09:04.466185 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0905 06:09:04.466293 20117 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0905 06:09:04.466328 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:04.466388 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0905 06:09:04.466374 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0905 06:09:04.466444 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0905 06:09:04.466465 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0905 06:09:04.466487 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:04.466531 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0905 06:09:04.466653 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:04.466687 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.466784 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.466843 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.466910 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0905 06:09:04.466988 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:04.467029 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:04.467081 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.467152 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:04.467173 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.467231 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:04.467993 20117 executor.go:111] Tasks: 79 done / 142 total; 41 can run W0905 06:09:04.468174 20117 api.go:53] PageSize not implemented I0905 06:09:04.468128 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:04.468192 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:04.468240 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:04.468259 20117 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0905 06:09:04.468246 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0905 06:09:04.468311 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:04.468315 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:04.468424 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:04.468411 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:04.468449 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0905 06:09:04.468594 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0905 06:09:04.468565 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:04.468639 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0905 06:09:04.468674 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0905 06:09:04.468672 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:04.468703 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } W0905 06:09:04.468795 20117 api.go:53] PageSize not implemented I0905 06:09:04.468816 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:04.468811 20117 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0905 06:09:04.468860 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0905 06:09:04.469185 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:04.469446 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:04.469605 20117 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0905 06:09:04.469687 20117 api.go:53] PageSize not implemented I0905 06:09:04.469677 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:04.469764 20117 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0905 06:09:04.469736 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:04.469750 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:04.469793 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:04.469831 20117 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0905 06:09:04.469805 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0905 06:09:04.469848 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:04.469999 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } W0905 06:09:04.470090 20117 api.go:53] PageSize not implemented I0905 06:09:04.470122 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:04.474276 20117 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0905 06:09:04.474375 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:04.474503 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:04.474543 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:04.474652 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:04.474767 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:04.475209 20117 executor.go:111] Tasks: 134 done / 142 total; 2 can run W0905 06:09:04.475308 20117 api.go:53] PageSize not implemented I0905 06:09:04.475332 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:04.475523 20117 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0905 06:09:04.475682 20117 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0905 06:09:04.478301 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0905 06:09:04.478348 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:09:04.478374 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0905 06:09:04.478395 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0905 06:09:04.478417 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:04.478443 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0905 06:09:04.478462 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0905 06:09:04.478482 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:04.478504 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0905 06:09:04.478525 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0905 06:09:04.478551 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0905 06:09:04.478580 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0905 06:09:04.478603 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0905 06:09:04.478628 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:09:04.478646 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:09:04.478667 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:04.478690 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0905 06:09:04.478710 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0905 06:09:04.478736 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:04.478759 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:04.478803 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:04.478829 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0905 06:09:04.478855 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:04.478880 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:04.478902 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0905 06:09:04.478923 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:09:04.478943 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0905 06:09:04.478962 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:04.478984 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:04.479009 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:04.479031 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0905 06:09:04.480273 20117 delete_cluster.go:128] Looking for cloud resources to delete W0905 06:09:04.480330 20117 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0905 06:09:04.480347 20117 keypairs.go:95] DescribeKeyPairs: { } I0905 06:09:04.480381 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.480425 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0905 06:09:04.480471 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.480516 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.480548 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.480585 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.480616 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.480648 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0905 06:09:04.480686 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.480721 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:04.480740 20117 natgateway.go:117] DescribeNatGateways: { } I0905 06:09:04.480773 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0905 06:09:04.480802 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W0905 06:09:04.480840 20117 api.go:53] PageSize not implemented I0905 06:09:04.480853 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0905 06:09:04.480881 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:04.480899 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:04.480931 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0905 06:09:04.480962 20117 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0905 06:09:04.480980 20117 targetgroups.go:35] PageSize not implemented I0905 06:09:04.480993 20117 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0905 06:09:04.481034 20117 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0905 06:09:04.481064 20117 iamrole.go:89] ListRoles: { } I0905 06:09:04.481100 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:04.481123 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:04.481166 20117 internetgateways.go:101] DescribeInternetGateways: { } I0905 06:09:04.481205 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:04.481237 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0905 06:09:04.481264 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0905 06:09:04.481289 20117 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0905 06:09:04.481776 20117 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I0905 06:09:04.481783 20117 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok keypair:key-1 ok autoscaling-config:lt-2 ok I0905 06:09:04.481890 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } autoscaling-group:nodes.privatecalico.example.com ok I0905 06:09:04.481882 20117 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0905 06:09:04.481954 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:04.481992 20117 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } autoscaling-group:bastion.privatecalico.example.com ok I0905 06:09:04.482003 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok load-balancer:api-privatecalico-example-0uch4k ok I0905 06:09:04.481901 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } volume:vol-1 ok I0905 06:09:04.482079 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok route53-record:Z1AFAKE1ZON3YO/A/api.internal.privatecalico.example.com. ok I0905 06:09:04.482014 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } I0905 06:09:04.482141 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } W0905 06:09:04.482187 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:04.482189 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } iam-instance-profile:nodes.privatecalico.example.com ok I0905 06:09:04.482204 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-3 ok I0905 06:09:04.482222 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0905 06:09:04.482255 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I0905 06:09:04.482245 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:04.482284 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0905 06:09:04.482385 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:04.482403 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0905 06:09:04.482471 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I0905 06:09:04.482593 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:04.482669 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0905 06:09:04.482861 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:04.482894 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0905 06:09:04.482954 20117 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0905 06:09:04.483025 20117 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0905 06:09:04.483094 20117 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0905 06:09:04.483207 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I0905 06:09:04.483224 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0905 06:09:04.483255 20117 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I0905 06:09:04.483279 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0905 06:09:04.483286 20117 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } I0905 06:09:04.483324 20117 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } elastic-ip:eipalloc-1 ok iam-role:masters.privatecalico.example.com ok I0905 06:09:04.483376 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0905 06:09:04.483363 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I0905 06:09:04.483438 20117 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I0905 06:09:04.483423 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:04.483464 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I0905 06:09:04.483514 20117 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I0905 06:09:04.483530 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0905 06:09:04.483560 20117 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I0905 06:09:04.483484 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 } ] } W0905 06:09:04.483595 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:04.483596 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0905 06:09:04.483607 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0905 06:09:04.483616 20117 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I0905 06:09:04.483679 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0905 06:09:04.483729 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0905 06:09:04.483790 20117 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0905 06:09:04.483848 20117 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (1.99s) === RUN TestLifecyclePrivateKopeio I0905 06:09:04.484403 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:09:04.485640 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:09:04.485699 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:09:04.485756 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:09:04.485825 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:09:04.485868 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:09:04.485999 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:09:04.486170 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:09:04.486233 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:09:04.486266 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I0905 06:09:04.513072 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:04.516032 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:04.516099 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:04.516140 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:05.108571 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:05.256450 20117 iamrole.go:89] ListRoles: { } I0905 06:09:05.257772 20117 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0905 06:09:05.258030 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:05.258188 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:05.258265 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0905 06:09:05.258357 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0905 06:09:05.258370 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:05.260279 20117 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0905 06:09:05.260712 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:05.261557 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:05.261766 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0905 06:09:05.261869 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0905 06:09:05.261785 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:05.262152 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:05.262095 20117 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0905 06:09:05.262246 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:05.262324 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0905 06:09:05.262381 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0905 06:09:05.262419 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:05.262465 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:05.262611 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:05.262522 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:05.262946 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0905 06:09:05.262994 20117 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0905 06:09:05.263175 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:09:05.263044 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatekopeio.example.com" }] } I0905 06:09:05.266101 20117 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0905 06:09:05.266233 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:05.266363 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0905 06:09:05.266333 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["privatekopeio.example.com"] }] } I0905 06:09:05.266386 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:09:05.266513 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0905 06:09:05.266470 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:05.266597 20117 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0905 06:09:05.266696 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0905 06:09:05.266648 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0905 06:09:05.266723 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0905 06:09:05.266779 20117 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0905 06:09:05.266707 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:05.266754 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0905 06:09:05.266807 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0905 06:09:05.266834 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0905 06:09:05.266866 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0905 06:09:05.266890 20117 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0905 06:09:05.266936 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:05.266978 20117 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0905 06:09:05.266962 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0905 06:09:05.267020 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:05.267120 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0905 06:09:05.267213 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0905 06:09:05.267214 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0905 06:09:05.267395 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:05.267494 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0905 06:09:05.267600 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:05.267751 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:05.267857 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:05.267851 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:09:05.267982 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] }] } I0905 06:09:05.268098 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0905 06:09:05.268075 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:09:05.268243 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:05.268108 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0905 06:09:05.268322 20117 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0905 06:09:05.268394 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0905 06:09:05.268508 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:05.268568 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:05.268615 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:05.268701 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:05.268746 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:05.268815 20117 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0905 06:09:05.268898 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0905 06:09:05.268937 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:05.268981 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0905 06:09:05.269095 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0905 06:09:05.269144 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0905 06:09:05.269212 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0905 06:09:05.269246 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:05.269307 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:05.269343 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:05.269373 20117 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0905 06:09:05.269406 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:05.269441 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0905 06:09:05.269470 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:05.269494 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:05.269524 20117 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" } ] } I0905 06:09:05.269579 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0905 06:09:05.269614 20117 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0905 06:09:05.269662 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:05.269719 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0905 06:09:05.269749 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:05.269773 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:05.269834 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0905 06:09:05.269881 20117 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0905 06:09:05.270069 20117 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0905 06:09:05.270254 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0905 06:09:05.270408 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:05.270448 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:05.270520 20117 api.go:53] PageSize not implemented I0905 06:09:05.270547 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } W0905 06:09:05.270524 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:05.270660 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:05.270737 20117 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] } I0905 06:09:05.270789 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:05.270755 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0905 06:09:05.270813 20117 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0905 06:09:05.270878 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0905 06:09:05.270954 20117 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0905 06:09:05.270786 20117 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-3" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I0905 06:09:05.271029 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:05.271061 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0905 06:09:05.271100 20117 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W0905 06:09:05.271166 20117 api.go:53] PageSize not implemented I0905 06:09:05.271181 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:05.271164 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0905 06:09:05.271370 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0905 06:09:05.271519 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:05.271585 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0905 06:09:05.271645 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0905 06:09:05.271751 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:09:05.271786 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" }] }] } I0905 06:09:05.271894 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:05.271951 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0905 06:09:05.272057 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:05.272106 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0905 06:09:05.272222 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0905 06:09:05.272259 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I0905 06:09:05.272339 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:05.272394 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:05.272444 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:05.272523 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0905 06:09:05.272615 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I0905 06:09:05.272731 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" }] }] } I0905 06:09:05.272844 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0905 06:09:05.272935 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0905 06:09:05.273032 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0905 06:09:05.273126 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0905 06:09:05.273222 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0905 06:09:05.273253 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0905 06:09:05.273344 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:09:05.273381 20117 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0905 06:09:05.273421 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0905 06:09:05.273462 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0905 06:09:05.273533 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0905 06:09:05.273625 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0905 06:09:05.274140 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I0905 06:09:05.274214 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0905 06:09:05.274250 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I0905 06:09:05.274276 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0905 06:09:05.274308 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0905 06:09:05.274333 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:05.274370 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" }] }] } I0905 06:09:05.274465 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I0905 06:09:05.274577 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0905 06:09:05.274679 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0905 06:09:05.274748 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I0905 06:09:05.274772 20117 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0905 06:09:05.274805 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0905 06:09:05.274834 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0905 06:09:05.274861 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0905 06:09:05.274913 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0905 06:09:05.274951 20117 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0905 06:09:05.274976 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0905 06:09:05.275002 20117 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0905 06:09:05.275033 20117 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0905 06:09:05.275057 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:05.275104 20117 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0905 06:09:05.275172 20117 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0905 06:09:05.275209 20117 api.go:53] PageSize not implemented I0905 06:09:05.275269 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:05.275337 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:05.275256 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:05.275249 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:05.275371 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } W0905 06:09:05.275492 20117 api.go:53] PageSize not implemented I0905 06:09:05.275536 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-1" } I0905 06:09:05.275538 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:05.275516 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:05.275604 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:05.275710 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-3" } I0905 06:09:05.279743 20117 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0905 06:09:05.279960 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:05.280072 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:05.280212 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:05.280319 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:05.280916 20117 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0905 06:09:05.281125 20117 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0905 06:09:05.281333 20117 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0905 06:09:05.281377 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:05.281406 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:05.281461 20117 dns.go:235] Pre-creating DNS records I0905 06:09:05.281483 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:05.286568 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:05.289565 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:05.289629 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:05.289671 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:05.889320 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:06.047254 20117 iamrole.go:89] ListRoles: { } I0905 06:09:06.049003 20117 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0905 06:09:06.049439 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:06.049434 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.049613 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.049734 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:06.049764 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:06.049812 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:06.049845 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.049963 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:06.050590 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.052447 20117 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0905 06:09:06.052558 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.052702 20117 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0905 06:09:06.052701 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:06.052747 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0905 06:09:06.052787 20117 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0905 06:09:06.052754 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0905 06:09:06.052870 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0905 06:09:06.052939 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0905 06:09:06.052938 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:06.052972 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0905 06:09:06.053000 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.053131 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0905 06:09:06.053242 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:06.053278 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.053361 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0905 06:09:06.053457 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:06.053493 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] }] } I0905 06:09:06.053595 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:06.053625 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.053713 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0905 06:09:06.053740 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.053826 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:06.053854 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.053941 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0905 06:09:06.054051 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:06.054097 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.054222 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:06.054293 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:06.054407 20117 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0905 06:09:06.054551 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0905 06:09:06.054672 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:06.054736 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:06.054752 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0905 06:09:06.054781 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0905 06:09:06.054702 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:06.054806 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0905 06:09:06.054876 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0905 06:09:06.054840 20117 api.go:53] PageSize not implemented I0905 06:09:06.054885 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0905 06:09:06.054976 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0905 06:09:06.054964 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.054948 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:06.055051 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.055095 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:06.055131 20117 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } W0905 06:09:06.055199 20117 api.go:53] PageSize not implemented I0905 06:09:06.055178 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:06.055228 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:06.055275 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:06.055583 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:06.055732 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0905 06:09:06.055826 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:06.055951 20117 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0905 06:09:06.056011 20117 api.go:53] PageSize not implemented I0905 06:09:06.056014 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:06.056047 20117 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0905 06:09:06.056034 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:06.056046 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:06.056118 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:06.056172 20117 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0905 06:09:06.056111 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:06.056213 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } W0905 06:09:06.056312 20117 api.go:53] PageSize not implemented I0905 06:09:06.056350 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:06.056498 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:06.060300 20117 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0905 06:09:06.060401 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.060529 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.060589 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.060721 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.061327 20117 executor.go:111] Tasks: 136 done / 144 total; 2 can run W0905 06:09:06.061423 20117 api.go:53] PageSize not implemented I0905 06:09:06.061447 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:06.061618 20117 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0905 06:09:06.061775 20117 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0905 06:09:06.064408 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0905 06:09:06.064461 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:09:06.064488 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0905 06:09:06.064509 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:06.064529 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0905 06:09:06.064549 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0905 06:09:06.064575 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:06.064600 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0905 06:09:06.064621 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0905 06:09:06.064647 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0905 06:09:06.064675 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0905 06:09:06.064699 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:09:06.064720 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:09:06.064742 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:06.064766 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0905 06:09:06.064787 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0905 06:09:06.064810 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0905 06:09:06.064833 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:06.064855 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:06.064879 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:06.064900 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0905 06:09:06.064922 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:06.064947 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:06.064968 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0905 06:09:06.064991 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0905 06:09:06.065019 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0905 06:09:06.065043 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:09:06.065062 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0905 06:09:06.065080 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:06.065102 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:06.065126 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:06.065149 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0905 06:09:06.066436 20117 delete_cluster.go:128] Looking for cloud resources to delete W0905 06:09:06.066499 20117 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0905 06:09:06.066513 20117 keypairs.go:95] DescribeKeyPairs: { } I0905 06:09:06.066543 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.066585 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0905 06:09:06.066631 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.066674 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.066705 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.066740 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.066770 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.066806 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0905 06:09:06.066855 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.066903 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:06.066928 20117 natgateway.go:117] DescribeNatGateways: { } I0905 06:09:06.066957 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0905 06:09:06.066988 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W0905 06:09:06.067028 20117 api.go:53] PageSize not implemented I0905 06:09:06.067041 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0905 06:09:06.067069 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:06.067087 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:06.067099 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0905 06:09:06.067126 20117 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0905 06:09:06.067143 20117 targetgroups.go:35] PageSize not implemented I0905 06:09:06.067156 20117 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" ] } I0905 06:09:06.067200 20117 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0905 06:09:06.067233 20117 iamrole.go:89] ListRoles: { } I0905 06:09:06.067279 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:06.067302 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:06.067341 20117 internetgateways.go:101] DescribeInternetGateways: { } I0905 06:09:06.067379 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:06.067416 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1","rtb-3"] } I0905 06:09:06.067447 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0905 06:09:06.067472 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } autoscaling-config:lt-1 ok I0905 06:09:06.067994 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } autoscaling-group:nodes.privatekopeio.example.com ok autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I0905 06:09:06.068047 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } iam-instance-profile:masters.privatekopeio.example.com ok I0905 06:09:06.068086 20117 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0905 06:09:06.068087 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0905 06:09:06.068092 20117 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } load-balancer:api-privatekopeio-example-tl2bv8 ok I0905 06:09:06.068144 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0905 06:09:06.068129 20117 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0905 06:09:06.068200 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0905 06:09:06.068196 20117 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } I0905 06:09:06.068239 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } autoscaling-group:bastion.privatekopeio.example.com ok I0905 06:09:06.068180 20117 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok iam-instance-profile:bastions.privatekopeio.example.com ok I0905 06:09:06.068266 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } keypair:key-1 ok iam-instance-profile:nodes.privatekopeio.example.com ok I0905 06:09:06.068297 20117 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok I0905 06:09:06.068173 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.privatekopeio.example.com. ok I0905 06:09:06.068317 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } W0905 06:09:06.068460 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:06.068482 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0905 06:09:06.068513 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:06.068548 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0905 06:09:06.068680 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:06.068697 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0905 06:09:06.068733 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0905 06:09:06.068810 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:06.068864 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0905 06:09:06.068945 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:06.068958 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok autoscaling-config:lt-3 ok I0905 06:09:06.069007 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0905 06:09:06.069108 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0905 06:09:06.069110 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I0905 06:09:06.069151 20117 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I0905 06:09:06.069163 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0905 06:09:06.069149 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:06.069188 20117 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I0905 06:09:06.069213 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I0905 06:09:06.069245 20117 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0905 06:09:06.069208 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I0905 06:09:06.069263 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } W0905 06:09:06.069308 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:06.069336 20117 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0905 06:09:06.069343 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } I0905 06:09:06.069351 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } security-group:sg-4 ok I0905 06:09:06.069378 20117 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I0905 06:09:06.069387 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } I0905 06:09:06.069401 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } subnet:subnet-4 ok I0905 06:09:06.069430 20117 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I0905 06:09:06.069441 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0905 06:09:06.069488 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0905 06:09:06.069582 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0905 06:09:06.069632 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0905 06:09:06.069679 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0905 06:09:06.069750 20117 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0905 06:09:06.069807 20117 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (1.59s) === RUN TestLifecycleIPv6 I0905 06:09:06.070332 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:09:06.070563 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:09:06.070595 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:09:06.070628 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:09:06.070657 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:09:06.070693 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:09:06.070722 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:09:06.070742 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:09:06.070768 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:09:06.070791 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I0905 06:09:06.099392 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:09:06.102436 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.102520 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.689602 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:06.834573 20117 iamrole.go:89] ListRoles: { } I0905 06:09:06.835780 20117 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0905 06:09:06.837211 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.837421 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.837837 20117 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.837935 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0905 06:09:06.837982 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0905 06:09:06.838020 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:06.838063 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:06.838114 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:06.838265 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.838494 20117 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0905 06:09:06.838613 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:09:06.838680 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:06.838959 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:06.839033 20117 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.839681 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0905 06:09:06.839861 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0905 06:09:06.840182 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.840700 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:06.841621 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:06.842216 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:06.842496 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0905 06:09:06.843042 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal-ipv6.example.com" }] } I0905 06:09:06.844602 20117 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0905 06:09:06.844804 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0905 06:09:06.844751 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0905 06:09:06.844863 20117 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0905 06:09:06.844849 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0905 06:09:06.844881 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:06.844959 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0905 06:09:06.844966 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:06.844998 20117 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0905 06:09:06.845064 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:06.845118 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:06.845104 20117 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0905 06:09:06.845147 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.845192 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0905 06:09:06.845250 20117 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.845300 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:06.845329 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.845425 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0905 06:09:06.845487 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:06.845537 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0905 06:09:06.845612 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:06.845650 20117 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0905 06:09:06.845599 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0905 06:09:06.845696 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0905 06:09:06.845843 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:06.845915 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.845998 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0905 06:09:06.846103 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.846180 20117 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0905 06:09:06.846218 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] }] } I0905 06:09:06.846287 20117 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] } I0905 06:09:06.846352 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:06.846394 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:06.846425 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0905 06:09:06.846510 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0905 06:09:06.846562 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0905 06:09:06.846713 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:06.846793 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0905 06:09:06.846869 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0905 06:09:06.846955 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0905 06:09:06.847016 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0905 06:09:06.847085 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:06.847143 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0905 06:09:06.847187 20117 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0905 06:09:06.847270 20117 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] } I0905 06:09:06.847568 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0905 06:09:06.847914 20117 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0905 06:09:06.848069 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.848237 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.848344 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:06.848366 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0905 06:09:06.848448 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:06.848473 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:06.848495 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I0905 06:09:06.848628 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.848896 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0905 06:09:06.849033 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.849133 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:06.849234 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0905 06:09:06.849284 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:06.849444 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-3" } I0905 06:09:06.849503 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:06.849629 20117 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.849592 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0905 06:09:06.849850 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.850030 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.850145 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:06.850222 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:09:06.850215 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.850283 20117 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.850333 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.850420 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] }] } I0905 06:09:06.850484 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0905 06:09:06.850477 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:09:06.850496 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0905 06:09:06.850572 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:09:06.850619 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:06.850758 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0905 06:09:06.850845 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.851003 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.851114 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.851226 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:06.851329 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0905 06:09:06.851389 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.851509 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.851607 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.851725 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" }] }] } I0905 06:09:06.851824 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0905 06:09:06.851927 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0905 06:09:06.851967 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:06.852010 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.852200 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.852312 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I0905 06:09:06.852425 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I0905 06:09:06.852532 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0905 06:09:06.852575 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:06.852692 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0905 06:09:06.852855 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0905 06:09:06.852906 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0905 06:09:06.852942 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0905 06:09:06.852972 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0905 06:09:06.852996 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0905 06:09:06.853029 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0905 06:09:06.853091 20117 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0905 06:09:06.853170 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:06.853230 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:06.853296 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:06.853292 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0905 06:09:06.853323 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I0905 06:09:06.853352 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:06.853404 20117 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-5" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I0905 06:09:06.853449 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0905 06:09:06.853506 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0905 06:09:06.853540 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:06.853609 20117 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-4"] }] } I0905 06:09:06.853686 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:06.853812 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I0905 06:09:06.853694 20117 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-4", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0905 06:09:06.853850 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-6" } I0905 06:09:06.853889 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0905 06:09:06.853931 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:06.854049 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0905 06:09:06.854103 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I0905 06:09:06.854131 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:06.854244 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I0905 06:09:06.854275 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:06.854335 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:06.854390 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0905 06:09:06.854419 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0905 06:09:06.854448 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0905 06:09:06.854486 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-2" } I0905 06:09:06.854457 20117 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I0905 06:09:06.854513 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0905 06:09:06.854558 20117 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0905 06:09:06.854551 20117 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0905 06:09:06.854591 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-5" } W0905 06:09:06.854619 20117 api.go:53] PageSize not implemented I0905 06:09:06.854616 20117 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-5"] }] } I0905 06:09:06.854702 20117 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-5", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }] }] } I0905 06:09:06.854773 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0905 06:09:06.854830 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0905 06:09:06.854860 20117 tags.go:42] CreateTags { Resources: ["subnet-5"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I0905 06:09:06.854925 20117 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0905 06:09:06.855000 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:06.855053 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:06.855020 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:06.855038 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:06.855169 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:06.855161 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I0905 06:09:06.855128 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:06.855187 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0905 06:09:06.855216 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:06.855225 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:06.855299 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:06.855341 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:06.855338 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I0905 06:09:06.855383 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0905 06:09:06.855393 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:06.855524 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-3" } I0905 06:09:06.855577 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:06.855696 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-3" } I0905 06:09:06.859720 20117 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0905 06:09:06.859886 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.859992 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.860070 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.860156 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.860791 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:09:06.860995 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:09:06.861239 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0905 06:09:06.861280 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:06.861307 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:06.861355 20117 dns.go:235] Pre-creating DNS records I0905 06:09:06.861377 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:06.866829 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0905 06:09:06.870012 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:06.870077 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:07.478075 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:07.628867 20117 iamrole.go:89] ListRoles: { } I0905 06:09:07.630290 20117 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0905 06:09:07.630574 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.630673 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:07.630704 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:07.630742 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:07.630774 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.630890 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:07.630997 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.631305 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.631423 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:07.633057 20117 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0905 06:09:07.633171 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:07.633303 20117 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0905 06:09:07.633275 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.633382 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0905 06:09:07.633368 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0905 06:09:07.633385 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.633464 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0905 06:09:07.633502 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0905 06:09:07.633521 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:07.633610 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.633723 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0905 06:09:07.633842 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:07.633886 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0905 06:09:07.633987 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:07.634016 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0905 06:09:07.634131 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:07.634173 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.634304 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.634717 20117 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0905 06:09:07.634808 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:07.634890 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:07.634982 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:07.635074 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.635203 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0905 06:09:07.635233 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.635335 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0905 06:09:07.635366 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0905 06:09:07.635405 20117 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0905 06:09:07.635436 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0905 06:09:07.635538 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.635644 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:07.635713 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:07.635781 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.635878 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:07.635929 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.636019 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:07.636124 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:07.636192 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.636281 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0905 06:09:07.636307 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:07.636367 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0905 06:09:07.636391 20117 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0905 06:09:07.636414 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0905 06:09:07.636645 20117 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0905 06:09:07.636740 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:07.636765 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:07.636839 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:07.636814 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:07.636855 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0905 06:09:07.636886 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0905 06:09:07.636913 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0905 06:09:07.636882 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:07.636941 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0905 06:09:07.636967 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0905 06:09:07.636993 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W0905 06:09:07.637043 20117 api.go:53] PageSize not implemented I0905 06:09:07.637066 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0905 06:09:07.637121 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:07.637185 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:07.637242 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:07.637301 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0905 06:09:07.637344 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:07.637429 20117 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0905 06:09:07.637479 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:07.637517 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:07.637518 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:07.637498 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:07.637559 20117 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0905 06:09:07.637531 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0905 06:09:07.637581 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:07.637605 20117 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0905 06:09:07.637575 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:07.637619 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:07.637642 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:07.637636 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0905 06:09:07.637702 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0905 06:09:07.637771 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:07.637840 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:07.637863 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0905 06:09:07.637957 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:07.637998 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0905 06:09:07.641824 20117 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0905 06:09:07.641964 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:07.642106 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:07.642265 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:07.642312 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:07.642871 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:09:07.643045 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:09:07.643231 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0905 06:09:07.645852 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0905 06:09:07.645904 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:09:07.645931 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0905 06:09:07.645953 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I0905 06:09:07.645975 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0905 06:09:07.645997 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:07.646024 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0905 06:09:07.646045 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0905 06:09:07.646066 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0905 06:09:07.646087 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:07.646108 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0905 06:09:07.646133 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0905 06:09:07.646159 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0905 06:09:07.646184 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0905 06:09:07.646207 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0905 06:09:07.646231 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:09:07.646250 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:09:07.646269 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:07.646291 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0905 06:09:07.646315 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0905 06:09:07.646337 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0905 06:09:07.646360 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:07.646381 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:07.646405 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:07.646428 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:07.646451 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:07.646470 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0905 06:09:07.646493 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0905 06:09:07.646517 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0905 06:09:07.646544 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0905 06:09:07.646568 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0905 06:09:07.646592 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:09:07.646613 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0905 06:09:07.646632 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:07.646658 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:07.646683 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:07.646706 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0905 06:09:07.648275 20117 delete_cluster.go:128] Looking for cloud resources to delete W0905 06:09:07.648326 20117 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0905 06:09:07.648342 20117 keypairs.go:95] DescribeKeyPairs: { } I0905 06:09:07.648376 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.648415 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0905 06:09:07.648462 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.648508 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.648543 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.648577 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.648614 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.648648 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0905 06:09:07.648694 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.649213 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:07.649240 20117 natgateway.go:117] DescribeNatGateways: { } I0905 06:09:07.649279 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0905 06:09:07.649308 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W0905 06:09:07.649347 20117 api.go:53] PageSize not implemented I0905 06:09:07.649362 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:07.649382 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:07.649394 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0905 06:09:07.649421 20117 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0905 06:09:07.649437 20117 targetgroups.go:35] PageSize not implemented I0905 06:09:07.649450 20117 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0905 06:09:07.649498 20117 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0905 06:09:07.649528 20117 iamrole.go:89] ListRoles: { } I0905 06:09:07.649571 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:07.649592 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:07.649624 20117 internetgateways.go:101] DescribeInternetGateways: { } I0905 06:09:07.649659 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:07.649696 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-3","rtb-1"] } I0905 06:09:07.649728 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0905 06:09:07.649754 20117 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0905 06:09:07.649782 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0905 06:09:07.649803 20117 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0905 06:09:07.650339 20117 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0905 06:09:07.650390 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.minimal-ipv6.example.com ok I0905 06:09:07.650408 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0905 06:09:07.650462 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0905 06:09:07.650581 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:07.650597 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0905 06:09:07.650560 20117 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I0905 06:09:07.650444 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:07.650540 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } route53-record:Z1AFAKE1ZON3YO/A/api.minimal-ipv6.example.com ok I0905 06:09:07.650629 20117 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } iam-instance-profile:masters.minimal-ipv6.example.com ok I0905 06:09:07.650686 20117 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0905 06:09:07.650692 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0905 06:09:07.650700 20117 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I0905 06:09:07.650744 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0905 06:09:07.650729 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } iam-instance-profile:nodes.minimal-ipv6.example.com ok autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok nat-gateway:nat-2 ok I0905 06:09:07.650780 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 } ] } W0905 06:09:07.651018 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:07.651037 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0905 06:09:07.651072 20117 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I0905 06:09:07.651148 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0905 06:09:07.651197 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0905 06:09:07.651254 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0905 06:09:07.651302 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:07.651354 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0905 06:09:07.651386 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0905 06:09:07.651473 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0905 06:09:07.651548 20117 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0905 06:09:07.651600 20117 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0905 06:09:07.651706 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I0905 06:09:07.651706 20117 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I0905 06:09:07.651774 20117 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0905 06:09:07.651811 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0905 06:09:07.651812 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0905 06:09:07.651844 20117 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I0905 06:09:07.651868 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0905 06:09:07.651874 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I0905 06:09:07.651925 20117 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0905 06:09:07.651946 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I0905 06:09:07.651935 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0905 06:09:07.652004 20117 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I0905 06:09:07.652004 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0905 06:09:07.652058 20117 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0905 06:09:07.652155 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0905 06:09:07.652228 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0905 06:09:07.652307 20117 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0905 06:09:07.652378 20117 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (1.58s) === RUN TestLifecycleSharedVPC I0905 06:09:07.652917 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:09:07.653142 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:09:07.653174 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:09:07.653206 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:09:07.653235 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:09:07.653269 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:09:07.653300 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:09:07.653325 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:09:07.653354 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:09:07.653375 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I0905 06:09:07.673991 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:07.679135 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:07.679211 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:08.277538 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:08.422943 20117 iamrole.go:89] ListRoles: { } I0905 06:09:08.423736 20117 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0905 06:09:08.423923 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:08.423948 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0905 06:09:08.424073 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0905 06:09:08.424863 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:08.425009 20117 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0905 06:09:08.425126 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:08.425269 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:08.425393 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:08.425435 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:08.425578 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:08.426520 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I0905 06:09:08.426725 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedvpc.example.com" }] } I0905 06:09:08.425660 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:08.427527 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:09:08.427631 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0905 06:09:08.427657 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0905 06:09:08.431608 20117 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0905 06:09:08.432504 20117 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0905 06:09:08.432588 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0905 06:09:08.432697 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0905 06:09:08.432787 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:09:08.432900 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0905 06:09:08.432972 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:08.433016 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:08.433045 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0905 06:09:08.433184 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0905 06:09:08.433240 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:08.433237 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0905 06:09:08.433270 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:08.433299 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:08.433436 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0905 06:09:08.433464 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0905 06:09:08.433527 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:08.433641 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0905 06:09:08.433729 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:08.433778 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:08.433737 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0905 06:09:08.433742 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0905 06:09:08.433821 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:08.433862 20117 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0905 06:09:08.434520 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0905 06:09:08.437337 20117 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0905 06:09:08.437516 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:08.437660 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0905 06:09:08.437717 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0905 06:09:08.437909 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0905 06:09:08.438073 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" }] }] } I0905 06:09:08.438231 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0905 06:09:08.438405 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" }] }] } I0905 06:09:08.438552 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0905 06:09:08.438706 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0905 06:09:08.438839 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:08.438988 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0905 06:09:08.439106 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:08.439169 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:08.439227 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" }] }] } I0905 06:09:08.439330 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" }] }] } I0905 06:09:08.439430 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0905 06:09:08.439527 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:08.439643 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0905 06:09:08.439792 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0905 06:09:08.439830 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0905 06:09:08.439891 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:08.439976 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:08.440056 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0905 06:09:08.440125 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0905 06:09:08.440285 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0905 06:09:08.440546 20117 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0905 06:09:08.440744 20117 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0905 06:09:08.440929 20117 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0905 06:09:08.440960 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:08.440999 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:08.441056 20117 dns.go:235] Pre-creating DNS records I0905 06:09:08.441080 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:08.445675 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:08.448263 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:08.448325 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:09.039636 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:09.184547 20117 iamrole.go:89] ListRoles: { } I0905 06:09:09.185555 20117 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0905 06:09:09.185953 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] }] } I0905 06:09:09.186015 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:09.186253 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:09:09.186342 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0905 06:09:09.186369 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0905 06:09:09.186790 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:09.186950 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:09.188070 20117 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0905 06:09:09.188177 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0905 06:09:09.188317 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:09.188263 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0905 06:09:09.188364 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:09:09.188442 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0905 06:09:09.188556 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:09.188635 20117 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0905 06:09:09.188596 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:09.188731 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:09.188770 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:09.192561 20117 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0905 06:09:09.192727 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:09.192854 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:09.192955 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:09.193107 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:09.193232 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:09.193337 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:09.193482 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:09.193853 20117 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0905 06:09:09.194031 20117 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0905 06:09:09.194190 20117 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0905 06:09:09.196249 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0905 06:09:09.196297 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0905 06:09:09.196321 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:09.196343 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0905 06:09:09.196361 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0905 06:09:09.196380 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0905 06:09:09.196401 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0905 06:09:09.196434 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0905 06:09:09.196459 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:09:09.196480 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:09:09.196498 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:09.196521 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0905 06:09:09.196539 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:09.196561 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:09.196581 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:09.196603 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:09.196622 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:09:09.196641 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0905 06:09:09.196660 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:09.196683 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:09.196707 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0905 06:09:09.197752 20117 delete_cluster.go:128] Looking for cloud resources to delete W0905 06:09:09.197805 20117 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0905 06:09:09.197818 20117 keypairs.go:95] DescribeKeyPairs: { } I0905 06:09:09.197846 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:09.197884 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0905 06:09:09.197923 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:09.197963 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:09.197991 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:09.198019 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:09.198052 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:09.198079 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0905 06:09:09.198109 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:09.198148 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0905 06:09:09.198172 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W0905 06:09:09.198208 20117 api.go:53] PageSize not implemented I0905 06:09:09.198227 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:09.198248 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:09.198263 20117 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0905 06:09:09.198281 20117 targetgroups.go:35] PageSize not implemented I0905 06:09:09.198296 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0905 06:09:09.198336 20117 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0905 06:09:09.198365 20117 iamrole.go:89] ListRoles: { } I0905 06:09:09.198398 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:09.198421 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:09.198458 20117 internetgateways.go:101] DescribeInternetGateways: { } I0905 06:09:09.198489 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:09.198510 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I0905 06:09:09.198856 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-group:nodes.sharedvpc.example.com ok I0905 06:09:09.199031 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0905 06:09:09.198956 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.sharedvpc.example.com. ok I0905 06:09:09.199106 20117 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0905 06:09:09.199162 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:09.199220 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0905 06:09:09.199273 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } iam-instance-profile:masters.sharedvpc.example.com ok I0905 06:09:09.199202 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0905 06:09:09.199308 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:09.199328 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0905 06:09:09.199326 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0905 06:09:09.199398 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok I0905 06:09:09.199354 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:09.199444 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0905 06:09:09.199608 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:09.199627 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0905 06:09:09.199703 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0905 06:09:09.199718 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I0905 06:09:09.199762 20117 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0905 06:09:09.199775 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0905 06:09:09.199799 20117 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I0905 06:09:09.199822 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I0905 06:09:09.199852 20117 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I0905 06:09:09.199862 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0905 06:09:09.199880 20117 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I0905 06:09:09.199928 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (1.55s) === RUN TestLifecycleComplex I0905 06:09:09.200451 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:09:09.200674 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:09:09.200706 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:09:09.200741 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:09:09.200771 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:09:09.200808 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:09:09.200841 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:09:09.200861 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:09:09.200887 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:09:09.200907 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I0905 06:09:09.227812 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:09:09.231196 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:09.231263 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:09.812159 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:09.970221 20117 iamrole.go:89] ListRoles: { } I0905 06:09:09.971461 20117 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0905 06:09:09.971658 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0905 06:09:09.971778 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0905 06:09:09.971852 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] } I0905 06:09:09.971861 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:09.971969 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:09.972085 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0905 06:09:09.972062 20117 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0905 06:09:09.972225 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0905 06:09:09.973361 20117 api.go:53] PageSize not implemented I0905 06:09:09.974305 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0905 06:09:09.974390 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:09.972394 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0905 06:09:09.974496 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0905 06:09:09.974617 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I0905 06:09:09.974706 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:09.975044 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:09.975136 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0905 06:09:09.975221 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:09.975306 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:09.975347 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0905 06:09:09.975565 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:09.975722 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:09.975803 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:09.976076 20117 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0905 06:09:09.976214 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:09:09.978684 20117 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0905 06:09:09.978872 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:09.978952 20117 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0905 06:09:09.978969 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0905 06:09:09.978992 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0905 06:09:09.979795 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:09.979794 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0905 06:09:09.979925 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0905 06:09:09.979940 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }], VpcId: "vpc-1" } I0905 06:09:09.980002 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0905 06:09:09.979942 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0905 06:09:09.980043 20117 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0905 06:09:09.980136 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0905 06:09:09.980162 20117 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0905 06:09:09.980219 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0905 06:09:09.980216 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:09.980250 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0905 06:09:09.980292 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0905 06:09:09.980331 20117 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0905 06:09:09.980408 20117 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0905 06:09:09.980405 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }], VpcId: "vpc-1" } I0905 06:09:09.980467 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:09.980388 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }], VpcId: "vpc-1" } I0905 06:09:09.980502 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:09.980545 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:09.980679 20117 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I0905 06:09:09.980722 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:09.980887 20117 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0905 06:09:09.980930 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0905 06:09:09.981043 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:09.981130 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:09.981207 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:09.981272 20117 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I0905 06:09:09.981312 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:09.981338 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:09.981279 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0905 06:09:09.981393 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0905 06:09:09.981438 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:09.981474 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:09.981504 20117 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0905 06:09:09.981578 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:09.981615 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0905 06:09:09.981699 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0905 06:09:09.981770 20117 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0905 06:09:09.981638 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0905 06:09:09.981854 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:09.981948 20117 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I0905 06:09:09.982040 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:09.982078 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0905 06:09:09.982260 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0905 06:09:09.982346 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:09.982389 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:09.982431 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0905 06:09:09.982484 20117 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I0905 06:09:09.982610 20117 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0905 06:09:09.982740 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" } ] }] } I0905 06:09:09.982875 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:09.982982 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-1", TransitGatewayId: "tgw-0123456" } I0905 06:09:09.983026 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0905 06:09:09.983194 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0905 06:09:09.983280 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:09.983375 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-1", TransitGatewayId: "tgw-123456" } I0905 06:09:09.983478 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0905 06:09:09.983682 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0905 06:09:09.983929 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0905 06:09:09.984200 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0905 06:09:09.984353 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:09.984518 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I0905 06:09:09.984630 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:09:09.984680 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:09.984763 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:09.984837 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:09.984899 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:09.984967 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" } ] }] } I0905 06:09:09.985102 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" } ] }] } I0905 06:09:09.985230 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0905 06:09:09.985269 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:09.985304 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0905 06:09:09.985477 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" } ] }] } I0905 06:09:09.985617 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0905 06:09:09.985651 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0905 06:09:09.985683 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0905 06:09:09.985814 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" } ] }] } I0905 06:09:09.985939 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0905 06:09:09.986019 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0905 06:09:09.986052 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0905 06:09:09.986076 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I0905 06:09:09.986146 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0905 06:09:09.986214 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0905 06:09:09.986322 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I0905 06:09:09.986399 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0905 06:09:09.986441 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" } ] }] } I0905 06:09:09.986555 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" } ] }] } I0905 06:09:09.986663 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I0905 06:09:09.986734 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I0905 06:09:09.986802 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0905 06:09:09.986906 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" } ] }] } I0905 06:09:09.987005 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0905 06:09:09.987042 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0905 06:09:09.987140 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I0905 06:09:09.987230 20117 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0905 06:09:09.987281 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:09.987304 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:09.987376 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:09.987377 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0905 06:09:09.987406 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0905 06:09:09.987457 20117 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-2" }], Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" } ], Type: "network" } I0905 06:09:09.987540 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:09.987581 20117 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0905 06:09:09.987652 20117 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0905 06:09:09.987700 20117 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0905 06:09:09.987754 20117 api.go:53] PageSize not implemented I0905 06:09:09.987804 20117 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0905 06:09:09.987855 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:09.987899 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:09.987964 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:09.987934 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:09.987983 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:09.988035 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:09.988067 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:09.988140 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:09.988094 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:09.988157 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:09.992465 20117 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0905 06:09:09.992612 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:09.992712 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:09.992799 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:09.992894 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:09.993382 20117 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0905 06:09:09.993592 20117 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0905 06:09:09.993764 20117 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0905 06:09:09.993800 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:09.993832 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:09.993887 20117 dns.go:235] Pre-creating DNS records I0905 06:09:09.993909 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:10.000182 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:09:10.003511 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:10.003577 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:10.605701 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:10.765738 20117 iamrole.go:89] ListRoles: { } I0905 06:09:10.766944 20117 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0905 06:09:10.767115 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0905 06:09:10.767195 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:10.767392 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0905 06:09:10.767519 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0905 06:09:10.767641 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0905 06:09:10.767752 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0905 06:09:10.767862 20117 api.go:53] PageSize not implemented I0905 06:09:10.767861 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0905 06:09:10.767935 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:10.767957 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:10.767998 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:10.768196 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0905 06:09:10.768386 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:10.769429 20117 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0905 06:09:10.769555 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0905 06:09:10.769703 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:10.769750 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0905 06:09:10.769750 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:10.769833 20117 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0905 06:09:10.769832 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:10.769873 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0905 06:09:10.769889 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0905 06:09:10.769891 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0905 06:09:10.770037 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:10.769937 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0905 06:09:10.770080 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:10.770110 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0905 06:09:10.770091 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:10.770173 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:10.770283 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:10.770350 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:10.770438 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0905 06:09:10.770554 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:10.770597 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:10.770756 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:10.770792 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:10.770875 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:10.770937 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:10.771039 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:10.771174 20117 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0905 06:09:10.771319 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:10.771379 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:10.771524 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:10.771680 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:10.771853 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:10.772130 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:10.772283 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:10.772373 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:10.772451 20117 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0905 06:09:10.772518 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:10.772573 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:10.772523 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:10.772589 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:10.772621 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:10.772647 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0905 06:09:10.772677 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:10.772701 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:10.772725 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0905 06:09:10.772794 20117 api.go:53] PageSize not implemented I0905 06:09:10.772835 20117 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0905 06:09:10.772897 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:10.772934 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:10.772925 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:10.772983 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:10.772955 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:10.773030 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:10.773001 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:10.773064 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:10.773097 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:10.773177 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:10.773241 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:10.773263 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:10.773348 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:10.773370 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:10.778119 20117 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0905 06:09:10.778243 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:10.778374 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:10.778432 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:10.778564 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:10.779205 20117 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0905 06:09:10.779441 20117 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0905 06:09:10.779674 20117 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I0905 06:09:10.788841 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:10.791859 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:10.802644 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:09:10.806001 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:10.806072 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:11.406958 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:11.568511 20117 iamrole.go:89] ListRoles: { } I0905 06:09:11.570363 20117 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0905 06:09:11.570554 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0905 06:09:11.570709 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W0905 06:09:11.570874 20117 api.go:53] PageSize not implemented I0905 06:09:11.570857 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:11.570990 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:11.571074 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:11.571450 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0905 06:09:11.571700 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:11.571800 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:11.571824 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:11.571868 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:11.572151 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:11.572347 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0905 06:09:11.573398 20117 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0905 06:09:11.573647 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0905 06:09:11.573550 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:11.573675 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0905 06:09:11.573754 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:11.573790 20117 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0905 06:09:11.573738 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:11.573797 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0905 06:09:11.573870 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:11.573902 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0905 06:09:11.573985 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:11.574011 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0905 06:09:11.573907 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0905 06:09:11.574117 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:11.574173 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:11.574263 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:11.574330 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0905 06:09:11.574451 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:11.574487 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:11.574551 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:11.574656 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:11.574682 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:11.574744 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:11.574841 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0905 06:09:11.574956 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:11.574997 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:11.575138 20117 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0905 06:09:11.575280 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:11.575361 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:11.575701 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:11.575882 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:11.576013 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:11.576201 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:11.576288 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:11.576433 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:11.576603 20117 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0905 06:09:11.576664 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:11.576705 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:11.576795 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:11.576819 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:11.576869 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:11.576914 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0905 06:09:11.576962 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:11.577000 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:11.577040 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0905 06:09:11.577190 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I0905 06:09:11.577226 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0905 06:09:11.577264 20117 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I0905 06:09:11.577303 20117 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I0905 06:09:11.577347 20117 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0905 06:09:11.577434 20117 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0905 06:09:11.577504 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:11.577544 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W0905 06:09:11.577592 20117 api.go:53] PageSize not implemented I0905 06:09:11.577647 20117 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0905 06:09:11.577699 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:11.577743 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:11.577729 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:11.577787 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:11.577766 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:11.577807 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:11.577866 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:11.577880 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:11.577899 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:11.577944 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:11.577999 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:11.578073 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:11.578120 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:11.578132 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:11.582355 20117 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0905 06:09:11.582482 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:11.582592 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:11.582725 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:11.582786 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:11.583303 20117 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0905 06:09:11.583491 20117 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0905 06:09:11.583721 20117 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0905 06:09:11.583766 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:11.583795 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:11.583853 20117 dns.go:235] Pre-creating DNS records I0905 06:09:11.590130 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:09:11.593605 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:11.593679 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:12.185133 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:12.343550 20117 iamrole.go:89] ListRoles: { } I0905 06:09:12.344808 20117 executor.go:111] Tasks: 0 done / 135 total; 51 can run W0905 06:09:12.345054 20117 api.go:53] PageSize not implemented I0905 06:09:12.345021 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:12.345210 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:12.345349 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:12.345501 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0905 06:09:12.345596 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0905 06:09:12.345664 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:12.345764 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0905 06:09:12.345832 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:12.345901 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:12.345923 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:12.345964 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:12.346124 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0905 06:09:12.351511 20117 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0905 06:09:12.351618 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0905 06:09:12.351670 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:12.351693 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0905 06:09:12.351729 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:12.351832 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0905 06:09:12.351846 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:12.351959 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:12.352023 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:12.352052 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0905 06:09:12.352610 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:12.352063 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0905 06:09:12.352666 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0905 06:09:12.352709 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:12.352839 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:12.352967 20117 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0905 06:09:12.352939 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0905 06:09:12.353146 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:12.353205 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:12.353347 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:12.353473 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:12.353599 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:12.353715 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:12.353821 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0905 06:09:12.354004 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:12.354103 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:12.354488 20117 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0905 06:09:12.354661 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:12.354942 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:12.355075 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:12.355176 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:12.355269 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:12.355371 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:12.355434 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:12.355581 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:12.355805 20117 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0905 06:09:12.355872 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:12.355928 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:12.355944 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:12.355909 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:12.355976 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:12.356000 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0905 06:09:12.356030 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:12.356054 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:12.356076 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0905 06:09:12.356146 20117 api.go:53] PageSize not implemented I0905 06:09:12.356186 20117 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0905 06:09:12.356233 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:12.356269 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:12.356269 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:12.356282 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:12.356325 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:12.356347 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:12.356368 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:12.356428 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:12.356473 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:12.356457 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:12.356542 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:12.356568 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:12.356642 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:12.356667 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:12.360648 20117 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0905 06:09:12.360777 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:12.360927 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:12.360988 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:12.361127 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:12.361580 20117 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0905 06:09:12.361796 20117 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0905 06:09:12.362014 20117 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I0905 06:09:12.365312 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:12.368355 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:12.378337 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:09:12.381834 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:12.381903 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:12.963900 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:13.127088 20117 iamrole.go:89] ListRoles: { } I0905 06:09:13.128762 20117 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0905 06:09:13.128998 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I0905 06:09:13.129168 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0905 06:09:13.129314 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0905 06:09:13.129392 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0905 06:09:13.129462 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0905 06:09:13.129587 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:13.129538 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } W0905 06:09:13.129657 20117 api.go:53] PageSize not implemented I0905 06:09:13.129712 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0905 06:09:13.129832 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.129957 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:13.129981 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:13.130026 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:13.130065 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.131472 20117 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0905 06:09:13.131602 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:13.131735 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.131834 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0905 06:09:13.131784 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0905 06:09:13.131959 20117 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0905 06:09:13.131916 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.131979 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:13.132032 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0905 06:09:13.132057 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.132084 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0905 06:09:13.132200 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:13.132213 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:13.132242 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0905 06:09:13.132291 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0905 06:09:13.132461 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:13.132511 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:13.132625 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.132763 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:13.132802 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0905 06:09:13.132934 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:13.132991 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0905 06:09:13.133143 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:13.133206 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.133363 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:13.133396 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:13.133541 20117 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0905 06:09:13.133680 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.133789 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:13.133879 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:13.134034 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:13.134177 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:13.134281 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:13.134425 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:13.134484 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:13.134731 20117 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0905 06:09:13.134787 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:13.134818 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:13.134887 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:13.134903 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.134935 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.134961 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0905 06:09:13.134988 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:13.135012 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:13.135033 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0905 06:09:13.135107 20117 api.go:53] PageSize not implemented I0905 06:09:13.135163 20117 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0905 06:09:13.135207 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:13.135271 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:13.135239 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:13.135320 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:13.135293 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.135357 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:13.135400 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:13.135433 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:13.135515 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:13.135540 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.135634 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:13.135677 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.135772 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:13.135817 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.139879 20117 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0905 06:09:13.140031 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.140171 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.140227 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.140375 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.140780 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.140833 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.141037 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:09:13.141228 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:09:13.141403 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0905 06:09:13.141444 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:13.141472 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:13.141529 20117 dns.go:235] Pre-creating DNS records I0905 06:09:13.147681 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:09:13.151586 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.151666 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.742739 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:13.903330 20117 iamrole.go:89] ListRoles: { } I0905 06:09:13.904868 20117 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0905 06:09:13.905121 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.905225 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:13.905301 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0905 06:09:13.905441 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.906738 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0905 06:09:13.906832 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0905 06:09:13.907012 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } W0905 06:09:13.907121 20117 api.go:53] PageSize not implemented I0905 06:09:13.907342 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.907459 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.907529 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:13.907547 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:13.907583 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:13.907830 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0905 06:09:13.909077 20117 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0905 06:09:13.909229 20117 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0905 06:09:13.909194 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.909233 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0905 06:09:13.909311 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0905 06:09:13.909307 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:13.909298 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0905 06:09:13.909341 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0905 06:09:13.909405 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0905 06:09:13.909385 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0905 06:09:13.909457 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:13.909544 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:13.909571 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0905 06:09:13.909596 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:13.909677 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:13.909746 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0905 06:09:13.909865 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:13.909919 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:13.910017 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.910136 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:13.910168 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.910270 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:13.910337 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.910434 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:13.910467 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0905 06:09:13.910578 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:13.910660 20117 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0905 06:09:13.910752 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:13.910872 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:13.911076 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:13.911226 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:13.911353 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:13.911497 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:13.911602 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:13.911681 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:13.911867 20117 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0905 06:09:13.911935 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:13.911986 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:13.911939 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:13.912001 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.912030 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.912059 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0905 06:09:13.912087 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:13.912131 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:13.912167 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0905 06:09:13.912243 20117 api.go:53] PageSize not implemented I0905 06:09:13.912283 20117 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0905 06:09:13.912345 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:13.912381 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:13.912400 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:13.912378 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0905 06:09:13.912423 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0905 06:09:13.912432 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:13.912452 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.912519 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:13.912547 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.912660 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:13.912733 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:13.912758 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.912843 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:13.912883 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:13.917110 20117 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0905 06:09:13.917217 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.917348 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.917428 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.917576 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.918319 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:09:13.918520 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:09:13.918741 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I0905 06:09:13.922584 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:13.925435 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.925521 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.937305 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:09:13.941863 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.941945 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:13.941984 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:14.514794 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:14.664180 20117 iamrole.go:89] ListRoles: { } I0905 06:09:14.665638 20117 executor.go:111] Tasks: 0 done / 136 total; 52 can run W0905 06:09:14.665871 20117 api.go:53] PageSize not implemented I0905 06:09:14.665961 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0905 06:09:14.666111 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:14.666202 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0905 06:09:14.666333 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0905 06:09:14.666429 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:14.666451 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:14.666502 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:14.666568 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:14.666631 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0905 06:09:14.666717 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:14.666758 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:14.666874 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0905 06:09:14.667010 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0905 06:09:14.667979 20117 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0905 06:09:14.668091 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I0905 06:09:14.668157 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0905 06:09:14.668224 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0905 06:09:14.668302 20117 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0905 06:09:14.668220 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:14.668237 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0905 06:09:14.668341 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0905 06:09:14.668386 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:14.668418 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0905 06:09:14.668482 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:14.668506 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0905 06:09:14.668532 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:14.668597 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:14.668676 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0905 06:09:14.668820 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:14.668894 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:14.669045 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:14.669220 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:14.669410 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:14.669460 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:14.669566 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0905 06:09:14.669720 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:14.669837 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:14.669929 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:14.669987 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:14.670324 20117 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0905 06:09:14.670489 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:14.670608 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:14.670911 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:14.671151 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:14.671353 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:14.671425 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:14.671551 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:14.671582 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:14.671716 20117 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0905 06:09:14.671783 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0905 06:09:14.671787 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0905 06:09:14.671840 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:14.671900 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:14.671936 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:14.671963 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0905 06:09:14.671994 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:14.672022 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:14.672046 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0905 06:09:14.672135 20117 api.go:53] PageSize not implemented I0905 06:09:14.672181 20117 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0905 06:09:14.672242 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:14.672279 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:14.672255 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:14.672306 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:14.672299 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:14.672325 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:14.672426 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:14.672491 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:14.672366 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:14.672509 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:14.672592 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:14.672618 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:14.672701 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:14.672720 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:14.680841 20117 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0905 06:09:14.681033 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:14.681171 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:14.681265 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:14.681423 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:14.682087 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:09:14.682380 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:09:14.682622 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0905 06:09:14.682672 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:14.682703 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:14.682762 20117 dns.go:235] Pre-creating DNS records I0905 06:09:14.690227 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:09:14.693721 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:14.693792 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:14.693829 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:15.295708 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:15.448609 20117 iamrole.go:89] ListRoles: { } I0905 06:09:15.449926 20117 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0905 06:09:15.450164 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0905 06:09:15.450312 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0905 06:09:15.450390 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:15.450503 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:15.450639 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:15.450772 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:15.450799 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:15.452099 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0905 06:09:15.452626 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } W0905 06:09:15.452780 20117 api.go:53] PageSize not implemented I0905 06:09:15.452735 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0905 06:09:15.452940 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:15.453072 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:15.453206 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0905 06:09:15.456314 20117 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0905 06:09:15.456430 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:15.456586 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:15.457349 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0905 06:09:15.457417 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:15.457433 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0905 06:09:15.457519 20117 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0905 06:09:15.457544 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:15.457570 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:15.457650 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0905 06:09:15.457653 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:15.457732 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0905 06:09:15.457837 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:15.457877 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0905 06:09:15.457758 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:15.457974 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:15.458024 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:15.458134 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0905 06:09:15.458268 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:15.458307 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:15.458411 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0905 06:09:15.458532 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:15.458601 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:15.458690 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0905 06:09:15.458919 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:15.458974 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:15.459199 20117 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0905 06:09:15.459385 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:15.459534 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:15.459642 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:15.459764 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:15.459908 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:15.460027 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:15.460182 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:15.460288 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:15.460445 20117 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0905 06:09:15.460509 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:15.460563 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:15.460577 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:15.460538 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:15.460609 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:15.460635 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0905 06:09:15.460665 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:15.460688 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:15.460709 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0905 06:09:15.460778 20117 api.go:53] PageSize not implemented I0905 06:09:15.460818 20117 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0905 06:09:15.460864 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:15.460921 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:15.460894 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:15.460938 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:15.461002 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:15.461028 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:15.461066 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:15.461099 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:15.461057 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:15.461159 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:15.461180 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:15.461251 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:15.461289 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:15.461300 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:15.465566 20117 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0905 06:09:15.465662 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:15.465780 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:15.465854 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:15.466021 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:15.466651 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:09:15.466855 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:09:15.466993 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I0905 06:09:15.469858 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:15.472711 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:15.472776 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:15.472809 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:15.480574 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:09:15.483952 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:15.484015 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:15.484055 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:15.484086 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:16.074116 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:16.235216 20117 iamrole.go:89] ListRoles: { } I0905 06:09:16.236870 20117 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0905 06:09:16.237064 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0905 06:09:16.237297 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:16.237871 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:16.238023 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0905 06:09:16.238105 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0905 06:09:16.238372 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0905 06:09:16.238552 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0905 06:09:16.238758 20117 api.go:53] PageSize not implemented I0905 06:09:16.239178 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:16.239326 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0905 06:09:16.239416 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:16.239494 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:16.239520 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:16.239564 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:16.241134 20117 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0905 06:09:16.241227 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0905 06:09:16.241301 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:16.241255 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:16.241334 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0905 06:09:16.241420 20117 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0905 06:09:16.241374 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0905 06:09:16.241470 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:16.241374 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0905 06:09:16.241506 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0905 06:09:16.241489 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0905 06:09:16.241630 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:16.241733 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0905 06:09:16.241893 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:16.241979 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:16.242145 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:16.242204 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:16.242342 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:16.242386 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0905 06:09:16.242531 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:16.242604 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:16.242832 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:16.242957 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0905 06:09:16.243119 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:16.243276 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:16.243380 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:16.243500 20117 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0905 06:09:16.243658 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:16.243770 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:16.243881 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:16.244083 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] }] } I0905 06:09:16.244205 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:16.244412 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:16.244661 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:16.244839 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:16.244951 20117 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0905 06:09:16.245043 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:16.245130 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:16.245151 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:16.245042 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:16.245193 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:16.245277 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0905 06:09:16.245328 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:16.245354 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:16.245376 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0905 06:09:16.245472 20117 api.go:53] PageSize not implemented I0905 06:09:16.245528 20117 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0905 06:09:16.245586 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:16.245652 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:16.245669 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:16.245616 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:16.245753 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:16.245785 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:16.245816 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:16.245875 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:16.245813 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:16.245934 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:16.245981 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:16.246002 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:16.246108 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:16.246159 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:16.250491 20117 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0905 06:09:16.250596 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:16.250738 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:16.250807 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:16.250963 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:16.251596 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:09:16.251952 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:09:16.252182 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0905 06:09:16.252231 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:16.252258 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:16.252317 20117 dns.go:235] Pre-creating DNS records I0905 06:09:16.258647 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0905 06:09:16.262161 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:16.262236 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:16.262274 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:16.262303 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:16.864389 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:17.025305 20117 iamrole.go:89] ListRoles: { } I0905 06:09:17.026775 20117 executor.go:111] Tasks: 0 done / 136 total; 52 can run W0905 06:09:17.027106 20117 api.go:53] PageSize not implemented I0905 06:09:17.027054 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.027202 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0905 06:09:17.027258 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:17.027410 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0905 06:09:17.027491 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:17.027516 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:17.027552 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:17.027595 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0905 06:09:17.027710 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.027886 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.027983 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.028075 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0905 06:09:17.028145 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0905 06:09:17.029578 20117 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0905 06:09:17.029711 20117 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0905 06:09:17.029681 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.029798 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0905 06:09:17.029772 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:17.029807 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0905 06:09:17.029898 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:17.030894 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0905 06:09:17.029876 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0905 06:09:17.031010 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0905 06:09:17.031147 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:17.031187 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0905 06:09:17.031168 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:17.031409 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.031578 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:17.031703 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:17.031783 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.032002 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.032186 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0905 06:09:17.032475 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0905 06:09:17.032667 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:17.032766 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0905 06:09:17.032962 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:17.033039 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:17.033100 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:17.033353 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:17.033707 20117 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0905 06:09:17.034415 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:17.034931 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:17.035070 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:17.035227 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:17.035339 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:17.035403 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:17.035568 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.035692 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0905 06:09:17.036004 20117 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0905 06:09:17.036055 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:17.036100 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:17.036790 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:17.036807 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:17.036855 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:17.036883 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0905 06:09:17.036913 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0905 06:09:17.036938 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0905 06:09:17.036962 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0905 06:09:17.037035 20117 api.go:53] PageSize not implemented I0905 06:09:17.037089 20117 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0905 06:09:17.037152 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:17.037232 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:17.037256 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:17.037278 20117 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0905 06:09:17.037151 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:17.037308 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:17.037331 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:17.037411 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:17.037466 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:17.037487 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:17.037565 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:17.037595 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:17.037641 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0905 06:09:17.037657 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:17.041694 20117 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0905 06:09:17.041792 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:17.041922 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:17.041991 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:17.042139 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:17.042797 20117 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0905 06:09:17.042993 20117 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0905 06:09:17.043137 20117 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0905 06:09:17.043249 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0905 06:09:17.043287 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:09:17.043316 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0905 06:09:17.043337 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:17.043357 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0905 06:09:17.043376 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0905 06:09:17.043395 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:17.043417 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0905 06:09:17.043446 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0905 06:09:17.043471 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:09:17.043491 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:09:17.043509 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:17.043530 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0905 06:09:17.043550 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0905 06:09:17.043572 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:17.043594 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:17.043616 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:17.043637 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:17.043672 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:17.043690 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0905 06:09:17.043712 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0905 06:09:17.043734 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:09:17.043753 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0905 06:09:17.043771 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:17.043795 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:17.043818 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:17.043846 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0905 06:09:17.045932 20117 delete_cluster.go:128] Looking for cloud resources to delete W0905 06:09:17.045985 20117 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0905 06:09:17.046000 20117 keypairs.go:95] DescribeKeyPairs: { } I0905 06:09:17.046026 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.046068 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0905 06:09:17.046128 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.046204 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.046262 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.046327 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.046392 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.046448 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0905 06:09:17.046508 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.046600 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0905 06:09:17.046650 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W0905 06:09:17.046727 20117 api.go:53] PageSize not implemented I0905 06:09:17.046752 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:17.046782 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:17.046805 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0905 06:09:17.046855 20117 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0905 06:09:17.046895 20117 targetgroups.go:35] PageSize not implemented I0905 06:09:17.046919 20117 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" ] } I0905 06:09:17.047002 20117 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0905 06:09:17.047047 20117 iamrole.go:89] ListRoles: { } I0905 06:09:17.047081 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:17.047102 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:17.047139 20117 internetgateways.go:101] DescribeInternetGateways: { } I0905 06:09:17.047174 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:17.047208 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0905 06:09:17.047622 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:17.047663 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0905 06:09:17.047685 20117 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0905 06:09:17.047737 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } autoscaling-group:nodes.complex.example.com ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4 ok iam-instance-profile:masters.complex.example.com ok I0905 06:09:17.047755 20117 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok I0905 06:09:17.047809 20117 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5 ok I0905 06:09:17.047678 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 } ] } W0905 06:09:17.047859 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:17.047819 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0905 06:09:17.047873 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0905 06:09:17.047890 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok autoscaling-group:master-us-test-1a.masters.complex.example.com ok I0905 06:09:17.047900 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } I0905 06:09:17.047936 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok subnet:subnet-3 ok I0905 06:09:17.047993 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:17.048034 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0905 06:09:17.048059 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0905 06:09:17.047953 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.complex.example.com ok I0905 06:09:17.048105 20117 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0905 06:09:17.048174 20117 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0905 06:09:17.048205 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:17.048246 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 } ] } W0905 06:09:17.048502 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:17.048522 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-1 ok I0905 06:09:17.048560 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0905 06:09:17.048641 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0905 06:09:17.048678 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0905 06:09:17.048663 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I0905 06:09:17.048728 20117 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I0905 06:09:17.048745 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0905 06:09:17.048773 20117 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I0905 06:09:17.048815 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I0905 06:09:17.048860 20117 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I0905 06:09:17.048871 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0905 06:09:17.048891 20117 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I0905 06:09:17.048941 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0905 06:09:17.048995 20117 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0905 06:09:17.049046 20117 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (7.85s) === RUN TestLifecycleExternalLB I0905 06:09:17.049579 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:09:17.049802 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:09:17.049834 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:09:17.049869 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:09:17.049898 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:09:17.049934 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:09:17.049965 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:09:17.049985 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:09:17.050014 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:09:17.050035 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I0905 06:09:17.069655 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:17.072303 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:17.072377 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:17.674295 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:17.814972 20117 iamrole.go:89] ListRoles: { } I0905 06:09:17.816017 20117 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0905 06:09:17.816289 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W0905 06:09:17.816330 20117 api.go:53] PageSize not implemented I0905 06:09:17.816349 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I0905 06:09:17.816492 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0905 06:09:17.817803 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I0905 06:09:17.817884 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] } I0905 06:09:17.816453 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0905 06:09:17.818059 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0905 06:09:17.818094 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0905 06:09:17.818195 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0905 06:09:17.818181 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:17.818264 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0905 06:09:17.818435 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0905 06:09:17.818412 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:17.818560 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:17.818597 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0905 06:09:17.818674 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0905 06:09:17.818714 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0905 06:09:17.818945 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:17.819247 20117 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" }] }] } I0905 06:09:17.819423 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } W0905 06:09:17.819651 20117 api.go:53] PageSize not implemented I0905 06:09:17.820336 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:17.820708 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:17.820899 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:17.821052 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } W0905 06:09:17.821241 20117 api.go:53] PageSize not implemented I0905 06:09:17.821363 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:17.821760 20117 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.821589 20117 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.822703 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0905 06:09:17.822750 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0905 06:09:17.823376 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:17.823413 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:17.824886 20117 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0905 06:09:17.825083 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:17.825168 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0905 06:09:17.825293 20117 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0905 06:09:17.825249 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0905 06:09:17.825362 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0905 06:09:17.825303 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:09:17.825459 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0905 06:09:17.825403 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:17.825617 20117 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0905 06:09:17.825678 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0905 06:09:17.825856 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:17.825952 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:17.825995 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:17.825856 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0905 06:09:17.826040 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I0905 06:09:17.826127 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0905 06:09:17.826225 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" } ] }], VpcId: "vpc-1" } I0905 06:09:17.826215 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:17.826394 20117 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.826458 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:17.826535 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:17.826604 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:17.826642 20117 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0905 06:09:17.826696 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:17.826738 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:17.826770 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:17.826801 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:17.826828 20117 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0905 06:09:17.826857 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:17.826984 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0905 06:09:17.829354 20117 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0905 06:09:17.829550 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.829690 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.829801 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0905 06:09:17.829969 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:17.830060 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:17.830192 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0905 06:09:17.830386 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.830543 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0905 06:09:17.830693 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.830792 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:17.830862 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:17.830935 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0905 06:09:17.831003 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.831192 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.831303 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" }] }] } I0905 06:09:17.831402 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.831510 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:17.831599 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:17.831674 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0905 06:09:17.831736 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" }] }] } I0905 06:09:17.831858 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.831962 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0905 06:09:17.832069 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:17.832201 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0905 06:09:17.832235 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0905 06:09:17.832286 20117 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0905 06:09:17.832505 20117 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0905 06:09:17.832713 20117 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0905 06:09:17.832747 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:17.832781 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:17.832842 20117 dns.go:235] Pre-creating DNS records I0905 06:09:17.832866 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:17.837757 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:17.840442 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:17.840510 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:18.430743 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:18.580687 20117 iamrole.go:89] ListRoles: { } I0905 06:09:18.581732 20117 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0905 06:09:18.581939 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W0905 06:09:18.582259 20117 api.go:53] PageSize not implemented I0905 06:09:18.582243 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.582361 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0905 06:09:18.582450 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0905 06:09:18.582479 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } W0905 06:09:18.582783 20117 api.go:53] PageSize not implemented I0905 06:09:18.582721 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.583052 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:18.583127 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0905 06:09:18.583236 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0905 06:09:18.583276 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0905 06:09:18.583474 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.584002 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.584102 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:18.584125 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:18.584164 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } W0905 06:09:18.584323 20117 api.go:53] PageSize not implemented I0905 06:09:18.584420 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0905 06:09:18.584507 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0905 06:09:18.584532 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0905 06:09:18.585427 20117 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0905 06:09:18.585556 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.585653 20117 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0905 06:09:18.585680 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:18.585747 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0905 06:09:18.585757 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0905 06:09:18.585872 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:18.585917 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I0905 06:09:18.586016 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:18.586082 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0905 06:09:18.586192 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:18.586240 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] }] } I0905 06:09:18.586332 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:18.589932 20117 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0905 06:09:18.590064 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:18.590210 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:18.590380 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:18.590490 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:18.590663 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:18.590758 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:18.590889 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:18.591344 20117 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0905 06:09:18.591575 20117 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0905 06:09:18.591754 20117 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0905 06:09:18.594085 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0905 06:09:18.594135 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:09:18.594162 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0905 06:09:18.594185 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:18.594224 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0905 06:09:18.594246 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0905 06:09:18.594265 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:18.594297 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0905 06:09:18.594325 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0905 06:09:18.594354 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0905 06:09:18.594388 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:09:18.594413 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:09:18.594432 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:18.594454 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0905 06:09:18.594488 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:18.594522 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:18.594546 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:18.594569 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:18.594603 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:09:18.594633 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0905 06:09:18.594652 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:18.594676 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:18.594711 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:18.594744 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0905 06:09:18.595803 20117 delete_cluster.go:128] Looking for cloud resources to delete W0905 06:09:18.595868 20117 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0905 06:09:18.595887 20117 keypairs.go:95] DescribeKeyPairs: { } I0905 06:09:18.595922 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.595980 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0905 06:09:18.596025 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.596079 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.596122 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.596167 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.596203 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.596240 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0905 06:09:18.596274 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.596331 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0905 06:09:18.596361 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W0905 06:09:18.596402 20117 api.go:53] PageSize not implemented I0905 06:09:18.596428 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:18.596452 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:18.596465 20117 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0905 06:09:18.596482 20117 targetgroups.go:35] PageSize not implemented I0905 06:09:18.596493 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0905 06:09:18.596549 20117 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0905 06:09:18.596582 20117 iamrole.go:89] ListRoles: { } I0905 06:09:18.596625 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:18.596658 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:18.596697 20117 internetgateways.go:101] DescribeInternetGateways: { } I0905 06:09:18.596730 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:18.596767 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:18.597123 20117 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0905 06:09:18.597118 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0905 06:09:18.597179 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I0905 06:09:18.597180 20117 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0905 06:09:18.597223 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:nodes.externallb.example.com ok I0905 06:09:18.597249 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0905 06:09:18.597308 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok iam-instance-profile:masters.externallb.example.com ok I0905 06:09:18.597255 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.externallb.example.com. ok I0905 06:09:18.597274 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0905 06:09:18.597453 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:18.597476 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0905 06:09:18.597532 20117 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0905 06:09:18.597596 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0905 06:09:18.597663 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:18.597707 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0905 06:09:18.597802 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:18.597820 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I0905 06:09:18.597862 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0905 06:09:18.597959 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I0905 06:09:18.598010 20117 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I0905 06:09:18.598027 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0905 06:09:18.598004 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0905 06:09:18.598053 20117 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I0905 06:09:18.598103 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I0905 06:09:18.598162 20117 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I0905 06:09:18.598176 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0905 06:09:18.598201 20117 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I0905 06:09:18.598289 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0905 06:09:18.598368 20117 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0905 06:09:18.598443 20117 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (1.55s) === RUN TestLifecycleSharedSubnet I0905 06:09:18.599023 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:09:18.599253 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:09:18.599285 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:09:18.599320 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:09:18.599348 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:09:18.599384 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:09:18.599416 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:09:18.599437 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:09:18.599463 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:09:18.599484 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I0905 06:09:18.618195 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:18.620726 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:18.620791 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:19.213688 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:19.360941 20117 iamrole.go:89] ListRoles: { } I0905 06:09:19.361934 20117 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0905 06:09:19.362335 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0905 06:09:19.362400 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:19.362461 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0905 06:09:19.362568 20117 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0905 06:09:19.362697 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:09:19.362762 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0905 06:09:19.362783 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0905 06:09:19.363081 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:19.363195 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] }] } I0905 06:09:19.363320 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0905 06:09:19.363454 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0905 06:09:19.363527 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0905 06:09:19.363488 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:19.363605 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:19.363646 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:19.363725 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:19.364464 20117 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0905 06:09:19.364570 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0905 06:09:19.364722 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0905 06:09:19.364743 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedsubnet.example.com" }] }], VpcId: "vpc-12345678" } I0905 06:09:19.364825 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:19.364824 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0905 06:09:19.364864 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:19.364877 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0905 06:09:19.364907 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0905 06:09:19.364983 20117 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0905 06:09:19.365073 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0905 06:09:19.365239 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0905 06:09:19.365264 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0905 06:09:19.365342 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:19.365388 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:19.365428 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:09:19.365554 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:19.365589 20117 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] } I0905 06:09:19.366437 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0905 06:09:19.368945 20117 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0905 06:09:19.369130 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0905 06:09:19.369277 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0905 06:09:19.369430 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" }] }] } I0905 06:09:19.369579 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0905 06:09:19.369746 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:19.369837 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:19.369919 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" }] }] } I0905 06:09:19.370131 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0905 06:09:19.370294 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" }] }] } I0905 06:09:19.370413 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0905 06:09:19.370531 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0905 06:09:19.371812 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0905 06:09:19.372082 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0905 06:09:19.372278 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0905 06:09:19.372438 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0905 06:09:19.372625 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:19.372763 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:19.372887 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0905 06:09:19.373532 20117 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0905 06:09:19.374156 20117 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0905 06:09:19.374887 20117 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0905 06:09:19.375268 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:19.375325 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:19.375388 20117 dns.go:235] Pre-creating DNS records I0905 06:09:19.375415 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:19.380758 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:19.383493 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:19.383560 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:19.974075 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:20.119653 20117 iamrole.go:89] ListRoles: { } I0905 06:09:20.120625 20117 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0905 06:09:20.121091 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:20.121206 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:20.121337 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:09:20.121473 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0905 06:09:20.121506 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0905 06:09:20.121706 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0905 06:09:20.122604 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0905 06:09:20.124035 20117 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0905 06:09:20.124231 20117 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0905 06:09:20.124240 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0905 06:09:20.124349 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0905 06:09:20.124369 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:09:20.124495 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0905 06:09:20.124625 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:20.124676 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0905 06:09:20.124790 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:20.128546 20117 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0905 06:09:20.128680 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.128862 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.128967 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.129254 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.129879 20117 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0905 06:09:20.130067 20117 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0905 06:09:20.130217 20117 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0905 06:09:20.132356 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0905 06:09:20.132407 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0905 06:09:20.132431 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:20.132451 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0905 06:09:20.132468 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0905 06:09:20.132486 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0905 06:09:20.132507 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0905 06:09:20.132537 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0905 06:09:20.132562 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:09:20.132582 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:09:20.132599 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0905 06:09:20.132617 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:20.132636 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:20.132656 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:20.132676 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:09:20.132696 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0905 06:09:20.132714 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:20.132734 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:20.132755 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0905 06:09:20.133786 20117 delete_cluster.go:128] Looking for cloud resources to delete W0905 06:09:20.133838 20117 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0905 06:09:20.133852 20117 keypairs.go:95] DescribeKeyPairs: { } I0905 06:09:20.133882 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0905 06:09:20.133918 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0905 06:09:20.133955 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0905 06:09:20.134000 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0905 06:09:20.134030 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0905 06:09:20.134056 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0905 06:09:20.134086 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0905 06:09:20.134108 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0905 06:09:20.134132 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0905 06:09:20.134160 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0905 06:09:20.134181 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W0905 06:09:20.134214 20117 api.go:53] PageSize not implemented I0905 06:09:20.134233 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:20.134253 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:20.134268 20117 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0905 06:09:20.134285 20117 targetgroups.go:35] PageSize not implemented I0905 06:09:20.134301 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0905 06:09:20.134340 20117 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0905 06:09:20.134374 20117 iamrole.go:89] ListRoles: { } I0905 06:09:20.134408 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:20.134429 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:20.134461 20117 internetgateways.go:101] DescribeInternetGateways: { } I0905 06:09:20.134494 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:20.134777 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok autoscaling-group:nodes.sharedsubnet.example.com ok I0905 06:09:20.134847 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0905 06:09:20.134865 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } volume:vol-2 ok I0905 06:09:20.134910 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:20.134938 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0905 06:09:20.134964 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0905 06:09:20.135001 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok iam-instance-profile:nodes.sharedsubnet.example.com ok I0905 06:09:20.134957 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0905 06:09:20.135115 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:20.135136 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0905 06:09:20.134990 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.sharedsubnet.example.com. ok I0905 06:09:20.135172 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:20.135206 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0905 06:09:20.135281 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:20.135296 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I0905 06:09:20.135336 20117 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0905 06:09:20.135424 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I0905 06:09:20.135485 20117 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0905 06:09:20.135498 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0905 06:09:20.135526 20117 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok I0905 06:09:20.135560 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I0905 06:09:20.135601 20117 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0905 06:09:20.135612 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0905 06:09:20.135637 20117 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (1.54s) === RUN TestLifecyclePrivateSharedSubnet I0905 06:09:20.136115 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:09:20.136339 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:09:20.136372 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:09:20.136404 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:09:20.136431 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:09:20.136469 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:09:20.136499 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:09:20.136519 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:09:20.136546 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:09:20.136568 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I0905 06:09:20.161518 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:20.165947 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.166077 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.166158 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.761655 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:20.903949 20117 iamrole.go:89] ListRoles: { } I0905 06:09:20.905382 20117 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0905 06:09:20.905663 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0905 06:09:20.905770 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0905 06:09:20.905886 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0905 06:09:20.905967 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0905 06:09:20.906718 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:20.906873 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:20.906881 20117 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0905 06:09:20.907045 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0905 06:09:20.907071 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:20.907176 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0905 06:09:20.907321 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:20.907438 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:20.907482 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:20.907602 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:20.907686 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:20.907888 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:09:20.907966 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0905 06:09:20.907990 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0905 06:09:20.909552 20117 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0905 06:09:20.909718 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0905 06:09:20.909763 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0905 06:09:20.909814 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0905 06:09:20.909797 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0905 06:09:20.909865 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0905 06:09:20.909806 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0905 06:09:20.909928 20117 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0905 06:09:20.909947 20117 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0905 06:09:20.910035 20117 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0905 06:09:20.910033 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0905 06:09:20.910116 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:20.910140 20117 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0905 06:09:20.910159 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:20.910187 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0905 06:09:20.910239 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0905 06:09:20.910315 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0905 06:09:20.910378 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:20.910409 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:20.910386 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0905 06:09:20.910435 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0905 06:09:20.910569 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0905 06:09:20.910626 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:20.910659 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:20.910687 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:09:20.910768 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0905 06:09:20.910898 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0905 06:09:20.911108 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0905 06:09:20.911205 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0905 06:09:20.911297 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:09:20.911337 20117 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" }] } I0905 06:09:20.911416 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0905 06:09:20.911470 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:20.911525 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:20.911557 20117 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" }] } I0905 06:09:20.911462 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0905 06:09:20.911763 20117 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0905 06:09:20.911915 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0905 06:09:20.911982 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:20.912051 20117 loadbalancers.go:35] PageSize not implemented W0905 06:09:20.912037 20117 api.go:53] PageSize not implemented I0905 06:09:20.912054 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0905 06:09:20.912151 20117 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }], Type: "network" } I0905 06:09:20.912222 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0905 06:09:20.912262 20117 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } I0905 06:09:20.912262 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:20.912350 20117 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0905 06:09:20.912405 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:20.912432 20117 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0905 06:09:20.912292 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I0905 06:09:20.912479 20117 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } W0905 06:09:20.912545 20117 api.go:53] PageSize not implemented I0905 06:09:20.912559 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:20.912554 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0905 06:09:20.912672 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0905 06:09:20.912829 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0905 06:09:20.912959 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0905 06:09:20.913103 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0905 06:09:20.913182 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0905 06:09:20.913290 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0905 06:09:20.913439 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0905 06:09:20.913553 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0905 06:09:20.913627 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0905 06:09:20.913724 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0905 06:09:20.913815 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0905 06:09:20.913891 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0905 06:09:20.913992 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0905 06:09:20.914084 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" }] }] } I0905 06:09:20.914183 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.914278 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.914355 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0905 06:09:20.914509 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0905 06:09:20.914619 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0905 06:09:20.914721 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0905 06:09:20.914823 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0905 06:09:20.914911 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0905 06:09:20.915040 20117 executor.go:111] Tasks: 103 done / 123 total; 5 can run I0905 06:09:20.915134 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0905 06:09:20.915163 20117 api.go:53] PageSize not implemented I0905 06:09:20.915209 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:20.915235 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:20.915351 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0905 06:09:20.915389 20117 api.go:53] PageSize not implemented I0905 06:09:20.915416 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:20.915471 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:20.919664 20117 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0905 06:09:20.919827 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.919917 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.920049 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.920149 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.920521 20117 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0905 06:09:20.920709 20117 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0905 06:09:20.920936 20117 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0905 06:09:20.920981 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:20.921010 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:20.921065 20117 dns.go:235] Pre-creating DNS records I0905 06:09:20.921085 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:20.926097 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:20.931063 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.931325 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:20.931416 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:21.522438 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:21.665673 20117 iamrole.go:89] ListRoles: { } I0905 06:09:21.667080 20117 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0905 06:09:21.667287 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:21.667462 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:21.667914 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:21.668201 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:21.669314 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:09:21.669399 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0905 06:09:21.669421 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0905 06:09:21.670388 20117 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0905 06:09:21.670529 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0905 06:09:21.670626 20117 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0905 06:09:21.670672 20117 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0905 06:09:21.670710 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0905 06:09:21.670682 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0905 06:09:21.670749 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0905 06:09:21.670818 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0905 06:09:21.670843 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0905 06:09:21.670863 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:21.670922 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0905 06:09:21.671047 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:21.671096 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0905 06:09:21.671203 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:21.671239 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0905 06:09:21.671333 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0905 06:09:21.671436 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:21.671498 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:09:21.672166 20117 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0905 06:09:21.672302 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:21.672364 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:21.672379 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0905 06:09:21.672412 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0905 06:09:21.672438 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0905 06:09:21.672469 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0905 06:09:21.672495 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } W0905 06:09:21.672476 20117 api.go:53] PageSize not implemented I0905 06:09:21.672503 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:21.672575 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:21.672630 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0905 06:09:21.672656 20117 api.go:53] PageSize not implemented I0905 06:09:21.672684 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:21.672725 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:21.672755 20117 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0905 06:09:21.672979 20117 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0905 06:09:21.673047 20117 api.go:53] PageSize not implemented I0905 06:09:21.673057 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:21.673101 20117 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0905 06:09:21.673091 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:21.673119 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:21.673184 20117 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0905 06:09:21.673202 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W0905 06:09:21.673244 20117 api.go:53] PageSize not implemented I0905 06:09:21.673292 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:21.673366 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:21.677479 20117 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0905 06:09:21.677592 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:21.677729 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:21.677795 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:21.677942 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:21.678525 20117 executor.go:111] Tasks: 115 done / 123 total; 2 can run W0905 06:09:21.678605 20117 api.go:53] PageSize not implemented I0905 06:09:21.678621 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:21.678795 20117 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0905 06:09:21.679007 20117 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0905 06:09:21.681550 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0905 06:09:21.681600 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0905 06:09:21.681625 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:21.681645 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0905 06:09:21.681663 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0905 06:09:21.681682 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0905 06:09:21.681704 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0905 06:09:21.681728 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0905 06:09:21.681750 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0905 06:09:21.681777 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:09:21.681798 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:09:21.681815 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0905 06:09:21.681835 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:21.681855 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:21.681883 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:21.681905 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0905 06:09:21.681925 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:21.681947 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:09:21.681970 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0905 06:09:21.681990 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:21.682012 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:21.682037 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0905 06:09:21.683231 20117 delete_cluster.go:128] Looking for cloud resources to delete W0905 06:09:21.683290 20117 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0905 06:09:21.683305 20117 keypairs.go:95] DescribeKeyPairs: { } I0905 06:09:21.683336 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:21.683378 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0905 06:09:21.683424 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:21.683476 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:21.683506 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:21.683536 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:21.683568 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:21.683590 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0905 06:09:21.683615 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:21.683646 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0905 06:09:21.683669 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W0905 06:09:21.683701 20117 api.go:53] PageSize not implemented I0905 06:09:21.683713 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0905 06:09:21.683745 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:21.683764 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:21.683777 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0905 06:09:21.683809 20117 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0905 06:09:21.683827 20117 targetgroups.go:35] PageSize not implemented I0905 06:09:21.683841 20117 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" ] } I0905 06:09:21.683883 20117 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0905 06:09:21.683918 20117 iamrole.go:89] ListRoles: { } I0905 06:09:21.683954 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:21.683976 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:21.684010 20117 internetgateways.go:101] DescribeInternetGateways: { } I0905 06:09:21.684043 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:21.684447 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0905 06:09:21.684498 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok autoscaling-config:lt-1 ok I0905 06:09:21.684485 20117 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } load-balancer:api-private-shared-subnet-n2f8ak ok autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I0905 06:09:21.684555 20117 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0905 06:09:21.684612 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0905 06:09:21.684595 20117 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I0905 06:09:21.684656 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0905 06:09:21.684729 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } autoscaling-config:lt-3 ok I0905 06:09:21.684631 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:21.684800 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } iam-instance-profile:nodes.private-shared-subnet.example.com ok route53-record:Z1AFAKE1ZON3YO/A/api.private-shared-subnet.example.com ok autoscaling-config:lt-2 ok I0905 06:09:21.684892 20117 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok autoscaling-group:nodes.private-shared-subnet.example.com ok autoscaling-group:bastion.private-shared-subnet.example.com ok I0905 06:09:21.684984 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:21.685025 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W0905 06:09:21.685143 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:21.685122 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0905 06:09:21.685157 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0905 06:09:21.685165 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I0905 06:09:21.685189 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:21.685255 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0905 06:09:21.685409 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:21.685432 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0905 06:09:21.685474 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:21.685527 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W0905 06:09:21.685611 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:21.685622 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0905 06:09:21.685692 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I0905 06:09:21.685699 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:21.685734 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I0905 06:09:21.685739 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0905 06:09:21.685809 20117 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com W0905 06:09:21.685812 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:21.685827 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } I0905 06:09:21.685824 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } security-group:sg-2 ok I0905 06:09:21.685859 20117 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok I0905 06:09:21.685891 20117 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0905 06:09:21.685904 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0905 06:09:21.685927 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I0905 06:09:21.685978 20117 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0905 06:09:21.685990 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0905 06:09:21.686014 20117 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok I0905 06:09:21.686039 20117 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (1.55s) === RUN TestLifecyclePrivateSharedIP I0905 06:09:21.686568 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:09:21.686794 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:09:21.686827 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:09:21.686864 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:09:21.686891 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:09:21.686924 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:09:21.686955 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:09:21.686974 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:09:21.687002 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:09:21.687025 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I0905 06:09:21.708082 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:21.710897 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:21.710962 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:21.711002 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:22.314157 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:22.461125 20117 iamrole.go:89] ListRoles: { } I0905 06:09:22.462518 20117 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0905 06:09:22.462852 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0905 06:09:22.462994 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] } I0905 06:09:22.462881 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:22.463194 20117 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.463409 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I0905 06:09:22.463501 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0905 06:09:22.463572 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:09:22.463676 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0905 06:09:22.463700 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0905 06:09:22.463850 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] }] } I0905 06:09:22.463893 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:22.464014 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:22.464154 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:22.464145 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0905 06:09:22.464262 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-ip.example.com" }] } I0905 06:09:22.464291 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:22.464430 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:22.464537 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:22.465487 20117 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0905 06:09:22.465586 20117 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0905 06:09:22.465653 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0905 06:09:22.465650 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:22.465744 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0905 06:09:22.465761 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0905 06:09:22.465781 20117 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0905 06:09:22.465814 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0905 06:09:22.465886 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0905 06:09:22.465843 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0905 06:09:22.465869 20117 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0905 06:09:22.465903 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0905 06:09:22.466004 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0905 06:09:22.465970 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0905 06:09:22.466072 20117 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0905 06:09:22.466109 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0905 06:09:22.466137 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0905 06:09:22.466220 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:22.466259 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:22.466266 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0905 06:09:22.466301 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:22.466456 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] }], VpcId: "vpc-12345678" } I0905 06:09:22.466490 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0905 06:09:22.466663 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0905 06:09:22.466737 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:22.466772 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:22.466804 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:09:22.466892 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0905 06:09:22.467029 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0905 06:09:22.467099 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:22.467175 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:22.467246 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0905 06:09:22.467267 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I0905 06:09:22.467326 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0905 06:09:22.467410 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:22.467450 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:22.467492 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:22.467522 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0905 06:09:22.467654 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:22.467645 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I0905 06:09:22.467712 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0905 06:09:22.467750 20117 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0905 06:09:22.467814 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:22.467641 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0905 06:09:22.467862 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0905 06:09:22.467942 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:22.467975 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:22.468010 20117 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" } ] } I0905 06:09:22.468102 20117 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0905 06:09:22.468232 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.468377 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:22.468435 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:22.468510 20117 loadbalancers.go:35] PageSize not implemented W0905 06:09:22.468514 20117 api.go:53] PageSize not implemented I0905 06:09:22.468525 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0905 06:09:22.468603 20117 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I0905 06:09:22.468620 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:22.468570 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0905 06:09:22.468691 20117 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "Name", Value: "api.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0905 06:09:22.468740 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:22.468763 20117 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0905 06:09:22.468721 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" }] }] } I0905 06:09:22.468829 20117 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0905 06:09:22.468853 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" }] }] } I0905 06:09:22.469023 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.469180 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.469343 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.469456 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:22.469593 20117 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0905 06:09:22.469711 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:22.469788 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:22.469869 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.470013 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:22.470148 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0905 06:09:22.470202 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:22.470305 20117 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } I0905 06:09:22.470256 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } W0905 06:09:22.470428 20117 api.go:53] PageSize not implemented I0905 06:09:22.470458 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:22.470435 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.470595 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0905 06:09:22.470713 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0905 06:09:22.470758 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0905 06:09:22.470793 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0905 06:09:22.470913 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.471027 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0905 06:09:22.471132 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.471243 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0905 06:09:22.471355 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.471473 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0905 06:09:22.471564 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:22.471692 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:22.471737 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0905 06:09:22.471866 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0905 06:09:22.471930 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0905 06:09:22.471983 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0905 06:09:22.472084 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0905 06:09:22.472202 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.472318 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I0905 06:09:22.472418 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:22.472479 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" }] }] } I0905 06:09:22.472612 20117 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I0905 06:09:22.472744 20117 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0905 06:09:22.472809 20117 api.go:53] PageSize not implemented I0905 06:09:22.472844 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:22.472858 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:22.472889 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:22.472979 20117 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } W0905 06:09:22.473067 20117 api.go:53] PageSize not implemented I0905 06:09:22.472980 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:22.473077 20117 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0905 06:09:22.473145 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0905 06:09:22.473120 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:22.473156 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:22.473182 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0905 06:09:22.473211 20117 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0905 06:09:22.473265 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:22.477217 20117 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0905 06:09:22.477317 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:22.477492 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:22.477595 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:22.477684 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0905 06:09:22.477819 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:22.477904 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:22.478308 20117 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0905 06:09:22.478534 20117 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0905 06:09:22.478828 20117 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0905 06:09:22.478874 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:22.478903 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:22.478963 20117 dns.go:235] Pre-creating DNS records I0905 06:09:22.478988 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:22.483973 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:22.486754 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:22.486821 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:22.486860 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:23.068876 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:23.212069 20117 iamrole.go:89] ListRoles: { } I0905 06:09:23.213658 20117 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0905 06:09:23.213852 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.213960 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:23.214086 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.214278 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:23.214781 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0905 06:09:23.214868 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0905 06:09:23.214893 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0905 06:09:23.216379 20117 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0905 06:09:23.216542 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0905 06:09:23.216716 20117 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0905 06:09:23.216485 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.216771 20117 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0905 06:09:23.216697 20117 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0905 06:09:23.216830 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0905 06:09:23.216876 20117 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0905 06:09:23.216801 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0905 06:09:23.216970 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:23.217020 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0905 06:09:23.217164 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:23.217209 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.217320 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:23.217352 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0905 06:09:23.217431 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.217524 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0905 06:09:23.217552 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.217644 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0905 06:09:23.217756 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:23.217811 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0905 06:09:23.217974 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:23.218102 20117 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0905 06:09:23.218241 20117 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0905 06:09:23.218259 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:23.218316 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:23.218334 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0905 06:09:23.218369 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0905 06:09:23.218395 20117 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0905 06:09:23.218425 20117 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0905 06:09:23.218451 20117 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0905 06:09:23.218305 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } W0905 06:09:23.218473 20117 api.go:53] PageSize not implemented I0905 06:09:23.218513 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:23.218624 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:23.218590 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:23.218676 20117 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } W0905 06:09:23.218740 20117 api.go:53] PageSize not implemented I0905 06:09:23.218770 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:23.218975 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:23.219104 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:23.219174 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:23.219259 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:23.219346 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:23.219566 20117 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0905 06:09:23.219639 20117 api.go:53] PageSize not implemented I0905 06:09:23.219663 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:23.219709 20117 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0905 06:09:23.219673 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:23.219667 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:23.219750 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0905 06:09:23.219785 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0905 06:09:23.219843 20117 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" W0905 06:09:23.219809 20117 api.go:53] PageSize not implemented I0905 06:09:23.219908 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:23.220061 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:23.220168 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:23.223935 20117 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0905 06:09:23.224041 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:23.224138 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:23.224273 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:23.224321 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:23.224481 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0905 06:09:23.224899 20117 executor.go:111] Tasks: 124 done / 132 total; 2 can run W0905 06:09:23.224994 20117 api.go:53] PageSize not implemented I0905 06:09:23.225017 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:23.225174 20117 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0905 06:09:23.225316 20117 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0905 06:09:23.227853 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0905 06:09:23.227899 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0905 06:09:23.227924 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:23.227947 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0905 06:09:23.227966 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0905 06:09:23.227985 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0905 06:09:23.228014 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0905 06:09:23.228040 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0905 06:09:23.228064 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0905 06:09:23.228092 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0905 06:09:23.228115 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:09:23.228135 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:09:23.228153 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:23.228175 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0905 06:09:23.228195 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0905 06:09:23.228216 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:23.228237 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:23.228260 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0905 06:09:23.228281 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0905 06:09:23.228304 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:23.228326 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:23.228344 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0905 06:09:23.228369 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:09:23.228389 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0905 06:09:23.228407 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:23.228429 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:23.228452 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0905 06:09:23.229596 20117 delete_cluster.go:128] Looking for cloud resources to delete W0905 06:09:23.229651 20117 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0905 06:09:23.229666 20117 keypairs.go:95] DescribeKeyPairs: { } I0905 06:09:23.229697 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.229739 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0905 06:09:23.229785 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.229831 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.229858 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.229887 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.229916 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.229947 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0905 06:09:23.229983 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.230021 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:23.230040 20117 natgateway.go:117] DescribeNatGateways: { } I0905 06:09:23.230072 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0905 06:09:23.230095 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W0905 06:09:23.230127 20117 api.go:53] PageSize not implemented I0905 06:09:23.230142 20117 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0905 06:09:23.230169 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:23.230187 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:23.230197 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0905 06:09:23.230224 20117 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0905 06:09:23.230241 20117 targetgroups.go:35] PageSize not implemented I0905 06:09:23.230254 20117 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" ] } I0905 06:09:23.230298 20117 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0905 06:09:23.230331 20117 iamrole.go:89] ListRoles: { } I0905 06:09:23.230370 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:23.230391 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:23.230425 20117 internetgateways.go:101] DescribeInternetGateways: { } I0905 06:09:23.230464 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:23.230490 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0905 06:09:23.230515 20117 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0905 06:09:23.230541 20117 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } autoscaling-config:lt-2 ok autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I0905 06:09:23.231005 20117 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok I0905 06:09:23.231045 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:nodes.private-shared-ip.example.com ok I0905 06:09:23.231084 20117 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } load-balancer:api-private-shared-ip-exa-ohatqj ok I0905 06:09:23.231142 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0905 06:09:23.231211 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok I0905 06:09:23.231108 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.private-shared-ip.example.com. ok I0905 06:09:23.231131 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0905 06:09:23.231258 20117 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok autoscaling-group:bastion.private-shared-ip.example.com ok W0905 06:09:23.231298 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:23.231259 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0905 06:09:23.231324 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0905 06:09:23.231338 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } iam-instance-profile:bastions.private-shared-ip.example.com ok I0905 06:09:23.231379 20117 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0905 06:09:23.231409 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0905 06:09:23.231487 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } iam-instance-profile:nodes.private-shared-ip.example.com ok I0905 06:09:23.231447 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:23.231565 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } W0905 06:09:23.231677 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:23.231702 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0905 06:09:23.231757 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0905 06:09:23.231818 20117 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0905 06:09:23.231888 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0905 06:09:23.231943 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0905 06:09:23.232096 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:23.232145 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-1 ok I0905 06:09:23.232211 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-3 ok I0905 06:09:23.232344 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I0905 06:09:23.232350 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0905 06:09:23.232398 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0905 06:09:23.232389 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I0905 06:09:23.232437 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W0905 06:09:23.232542 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:23.232519 20117 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0905 06:09:23.232563 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0905 06:09:23.232591 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0905 06:09:23.232617 20117 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok I0905 06:09:23.232641 20117 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0905 06:09:23.232622 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0905 06:09:23.232651 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0905 06:09:23.232685 20117 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I0905 06:09:23.232705 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I0905 06:09:23.232738 20117 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0905 06:09:23.232746 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0905 06:09:23.232763 20117 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I0905 06:09:23.232824 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0905 06:09:23.232868 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecyclePrivateSharedIP (1.55s) === RUN TestLifecycleManyAddons I0905 06:09:23.233370 20117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:09:23.233593 20117 internetgateways.go:66] CreateInternetGateway: { } I0905 06:09:23.233629 20117 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:09:23.233661 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:09:23.233691 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:09:23.233726 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:09:23.233757 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:09:23.233777 20117 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:09:23.233805 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:09:23.233829 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0905 06:09:23.254614 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:23.257599 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:23.257684 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:23.850270 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:24.510221 20117 iamrole.go:89] ListRoles: { } I0905 06:09:24.511001 20117 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0905 06:09:24.511322 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] }] } I0905 06:09:24.511382 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:24.511490 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:24.511530 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0905 06:09:24.511636 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0905 06:09:24.511650 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:24.511695 20117 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0905 06:09:24.511743 20117 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0905 06:09:24.511745 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:24.511899 20117 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0905 06:09:24.512044 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:24.512099 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:24.512317 20117 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.512498 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:24.512662 20117 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0905 06:09:24.512728 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:24.512933 20117 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.513033 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:09:24.513087 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0905 06:09:24.513117 20117 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0905 06:09:24.513136 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:24.513167 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:24.519971 20117 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0905 06:09:24.520202 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0905 06:09:24.520144 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0905 06:09:24.521033 20117 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0905 06:09:24.521054 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" }] }], VpcId: "vpc-1" } I0905 06:09:24.521188 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:24.521218 20117 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0905 06:09:24.521264 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0905 06:09:24.521275 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:24.521358 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:24.521435 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0905 06:09:24.521479 20117 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0905 06:09:24.521552 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:24.521703 20117 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0905 06:09:24.521744 20117 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.521883 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:24.521949 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0905 06:09:24.522144 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:24.522261 20117 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0905 06:09:24.522298 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:24.522372 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:24.522409 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:24.522451 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:24.522477 20117 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0905 06:09:24.522535 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:24.522566 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:24.522590 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0905 06:09:24.522671 20117 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0905 06:09:24.522724 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:24.522754 20117 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0905 06:09:24.523349 20117 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0905 06:09:24.523728 20117 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0905 06:09:24.523883 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" }] }] } I0905 06:09:24.524002 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.524572 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.524685 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" }] }] } I0905 06:09:24.524790 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0905 06:09:24.524931 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.525071 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.525168 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:24.525218 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.525304 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.525403 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0905 06:09:24.525513 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:24.525568 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:24.525615 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.525716 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.525804 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0905 06:09:24.525897 20117 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.525994 20117 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0905 06:09:24.526038 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:24.526118 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:24.526197 20117 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0905 06:09:24.526348 20117 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0905 06:09:24.526390 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0905 06:09:24.526424 20117 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0905 06:09:24.526452 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:24.526524 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:24.526887 20117 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0905 06:09:24.527075 20117 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0905 06:09:24.527326 20117 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0905 06:09:24.527392 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:24.527440 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:24.527538 20117 dns.go:235] Pre-creating DNS records I0905 06:09:24.527579 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:24.532767 20117 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0905 06:09:24.535774 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:24.535863 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:25.120808 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:25.761627 20117 iamrole.go:89] ListRoles: { } I0905 06:09:25.762380 20117 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0905 06:09:25.762564 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.762746 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] }] } I0905 06:09:25.762938 20117 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0905 06:09:25.763095 20117 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0905 06:09:25.763547 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.764186 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0905 06:09:25.764287 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:09:25.764310 20117 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:09:25.764348 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:25.765781 20117 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0905 06:09:25.765894 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.766003 20117 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0905 06:09:25.766035 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:25.766140 20117 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0905 06:09:25.766120 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0905 06:09:25.766302 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:25.766356 20117 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:09:25.766435 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.766587 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.766727 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0905 06:09:25.766873 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:25.766951 20117 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:09:25.773215 20117 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0905 06:09:25.774904 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:25.775080 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:25.775188 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:25.775385 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:25.775589 20117 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0905 06:09:25.775716 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:25.775846 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:25.776738 20117 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0905 06:09:25.776939 20117 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0905 06:09:25.777102 20117 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0905 06:09:25.779393 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0905 06:09:25.779442 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0905 06:09:25.779469 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0905 06:09:25.779489 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0905 06:09:25.779510 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0905 06:09:25.779529 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0905 06:09:25.779547 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0905 06:09:25.779568 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0905 06:09:25.779588 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0905 06:09:25.779616 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0905 06:09:25.779643 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0905 06:09:25.779663 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0905 06:09:25.779680 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0905 06:09:25.779701 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0905 06:09:25.779721 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:09:25.779740 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0905 06:09:25.779761 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:09:25.779784 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0905 06:09:25.779804 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0905 06:09:25.779821 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0905 06:09:25.779838 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0905 06:09:25.779858 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0905 06:09:25.779881 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:09:25.779902 20117 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0905 06:09:25.781152 20117 delete_cluster.go:128] Looking for cloud resources to delete W0905 06:09:25.781203 20117 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0905 06:09:25.781218 20117 keypairs.go:95] DescribeKeyPairs: { } I0905 06:09:25.781251 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.781310 20117 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0905 06:09:25.781351 20117 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.781391 20117 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.781423 20117 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.781460 20117 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.781489 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.781515 20117 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0905 06:09:25.781547 20117 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.781581 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0905 06:09:25.781608 20117 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0905 06:09:25.781641 20117 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0905 06:09:25.781667 20117 api.go:53] PageSize not implemented I0905 06:09:25.781682 20117 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0905 06:09:25.781703 20117 loadbalancers.go:35] PageSize not implemented I0905 06:09:25.781718 20117 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0905 06:09:25.781735 20117 targetgroups.go:35] PageSize not implemented I0905 06:09:25.781749 20117 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0905 06:09:25.781787 20117 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0905 06:09:25.781819 20117 iamrole.go:89] ListRoles: { } I0905 06:09:25.781853 20117 zones.go:93] ListHostedZonesPages { } I0905 06:09:25.781875 20117 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0905 06:09:25.781905 20117 internetgateways.go:101] DescribeInternetGateways: { } I0905 06:09:25.781938 20117 routetable.go:53] DescribeRouteTables: { } I0905 06:09:25.781963 20117 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0905 06:09:25.782298 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0905 06:09:25.782354 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } autoscaling-group:nodes.minimal.example.com ok I0905 06:09:25.782394 20117 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0905 06:09:25.782433 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0905 06:09:25.782468 20117 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-1 ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok iam-instance-profile:nodes.minimal.example.com ok I0905 06:09:25.782486 20117 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0905 06:09:25.782560 20117 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0905 06:09:25.782545 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0905 06:09:25.782398 20117 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.minimal.example.com. ok I0905 06:09:25.782655 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0905 06:09:25.782884 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:25.782924 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0905 06:09:25.783002 20117 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0905 06:09:25.783082 20117 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0905 06:09:25.783164 20117 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0905 06:09:25.783233 20117 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0905 06:09:25.783342 20117 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0905 06:09:25.783373 20117 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0905 06:09:25.783514 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0905 06:09:25.783529 20117 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0905 06:09:25.783568 20117 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0905 06:09:25.783603 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0905 06:09:25.783632 20117 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0905 06:09:25.783655 20117 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0905 06:09:25.783689 20117 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0905 06:09:25.783699 20117 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0905 06:09:25.783715 20117 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0905 06:09:25.783773 20117 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0905 06:09:25.783831 20117 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0905 06:09:25.783885 20117 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (2.55s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 120.865s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.006s ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I0905 06:07:24.944739 20118 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.004s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I0905 06:07:24.962481 20121 pod.go:59] starting pod controller I0905 06:07:24.962629 20121 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) PASS I0905 06:07:24.962721 20121 pod.go:107] Got stop signal I0905 06:07:24.962763 20121 pod.go:65] shutting down pod controller ok k8s.io/kops/dns-controller/pkg/watchers 0.024s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000355e0} route53_test.go:93: Got zone list: [0xc000035600] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c29b8} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000356c0} route53_test.go:93: Got zone list: [0xc0000356e0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c29c8} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc000035790} route53_test.go:170: Successfully added managed DNS zone: &{0xc00040a1b0 0xc0000c29e0} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000358c0} route53_test.go:93: Got zone list: [0xc0000358e0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c29f8} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000359b0} route53_test.go:93: Got zone list: [0xc0000359d0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c2a18} route53_test.go:187: Successfully added resource record set: {0xc0003e7d40 0xc0000c2a38} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035c20} route53_test.go:93: Got zone list: [0xc000035c40] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c2ac0} route53_test.go:199: Successfully added resource record set: {0xc0003e7ef0 0xc0000c2ae0} route53_test.go:118: Got 1 recordsets: [0xc000035da0] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035ec0} route53_test.go:93: Got zone list: [0xc000035ee0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c2b78} route53_test.go:221: Successfully added resource record set: {0xc000410120 0xc0000c2b98} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000410120 0xc0000c2b98}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041c270} route53_test.go:93: Got zone list: [0xc00041c290] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c2c50} route53_test.go:246: Successfully removed resource set {0xc000410360 0xc0000c2c70} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041c4e0} route53_test.go:93: Got zone list: [0xc00041c500] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c2cf8} route53_test.go:264: Successfully removed resource set {0xc000410510 0xc0000c2d18} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041c760} route53_test.go:93: Got zone list: [0xc00041c780] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c2da8} commontests.go:192: Successfully added resource record set: {0xc0004106c0 0xc0000c2dc8} commontests.go:45: Correctly replaced resource record {0xc0004106c0 0xc0000c2dc8} -> {0xc0004107e0 0xc0000c2e18} commontests.go:142: Got 1 recordsets: [0xc00041ca30] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041cbf0} route53_test.go:93: Got zone list: [0xc00041cc10] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c2ec8} commontests.go:192: Successfully added resource record set: {0xc000410ab0 0xc0000c2ee8} commontests.go:70: Correctly replaced resource record {0xc000410ab0 0xc0000c2ee8} -> {0xc000410bd0 0xc0000c2f38} commontests.go:142: Got 1 recordsets: [0xc00041cec0] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041d0b0} route53_test.go:93: Got zone list: [0xc00041d0d0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c2ff8} commontests.go:192: Successfully added resource record set: {0xc000410ea0 0xc0000c3018} commontests.go:142: Got 2 recordsets: [0xc00041d300 0xc00041d320] commontests.go:142: Got 2 recordsets: [0xc00041d370 0xc00041d390] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041d520} route53_test.go:93: Got zone list: [0xc00041d540] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e3d40 0xc0000c3118} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.011s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.006s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc000197ba0} clouddns_test.go:71: Got zone list: [0xc0004d81b0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d8180} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc000197be0} clouddns_test.go:71: Got zone list: [0xc0004d82d0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d82a0} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc000197c20} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc0004da840 0xc0004d8408} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc000197c60} clouddns_test.go:71: Got zone list: [0xc0004d8510] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d84e0} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc000197ca0} clouddns_test.go:71: Got zone list: [0xc0004d86c0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d8690} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc000196180} clouddns_test.go:71: Got zone list: [0xc0004d8120] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d8090} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc0001961e0} clouddns_test.go:71: Got zone list: [0xc0004d83c0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d8390} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc000196240} clouddns_test.go:71: Got zone list: [0xc0004d85e8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d85b8} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc0001962a0} clouddns_test.go:71: Got zone list: [0xc0004d8870] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d8840} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc000196300} clouddns_test.go:71: Got zone list: [0xc0004d8ac8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d8a98} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc000196340} clouddns_test.go:71: Got zone list: [0xc0004d8e40] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d8e10} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc000196380} clouddns_test.go:71: Got zone list: [0xc0004d9230] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d9200} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040b858 0xc0001964a0} clouddns_test.go:71: Got zone list: [0xc0004d96b0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004da6c0 0xc0004d9680} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.040s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.026s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.005s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.052s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I0905 06:07:28.269632 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.269809 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.269837 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.269865 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.269884 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.269914 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.269943 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.269952 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.269976 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.269991 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.275812 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I0905 06:07:28.279065 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.279830 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.279872 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.279900 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.279923 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.279946 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.279969 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.279983 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.280003 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.280017 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.281053 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.01s) === RUN TestContainerdBuilder_Simple I0905 06:07:28.284157 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.284276 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.284293 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.284311 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.284326 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.284344 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.284360 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.284373 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.284388 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.284398 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.285157 20829 zones.go:93] ListHostedZonesPages { } I0905 06:07:28.286537 20829 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I0905 06:07:28.286550 20829 assetstore.go:111] bin/containerd I0905 06:07:28.286556 20829 assetstore.go:111] bin/containerd-shim I0905 06:07:28.286567 20829 assetstore.go:111] bin/containerd-shim-runc-v1 I0905 06:07:28.286572 20829 assetstore.go:111] bin/containerd-shim-runc-v2 I0905 06:07:28.286577 20829 assetstore.go:111] bin/containerd-stress I0905 06:07:28.286582 20829 assetstore.go:111] bin/ctr I0905 06:07:28.286639 20829 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I0905 06:07:28.286650 20829 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.01s) === RUN TestContainerdBuilder_Flatcar I0905 06:07:28.289244 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.289346 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.289362 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.289380 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.289394 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.289412 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.289427 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.289440 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.289455 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.289466 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.290219 20829 zones.go:93] ListHostedZonesPages { } I0905 06:07:28.291438 20829 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I0905 06:07:28.292176 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.292291 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.292307 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.292324 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.292339 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.292358 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.292376 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.292390 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.292407 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.292418 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.293240 20829 zones.go:93] ListHostedZonesPages { } I0905 06:07:28.294505 20829 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I0905 06:07:28.295050 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.295148 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.295167 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.295186 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.295209 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.295240 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.295257 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.295270 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.295286 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.295297 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.296110 20829 zones.go:93] ListHostedZonesPages { } I0905 06:07:28.297459 20829 assetstore.go:108] Matching assets for "^docker/": I0905 06:07:28.297472 20829 assetstore.go:111] docker/containerd I0905 06:07:28.297478 20829 assetstore.go:111] docker/containerd-shim I0905 06:07:28.297483 20829 assetstore.go:111] docker/ctr I0905 06:07:28.297487 20829 assetstore.go:111] docker/docker I0905 06:07:28.297491 20829 assetstore.go:111] docker/docker-init I0905 06:07:28.297496 20829 assetstore.go:111] docker/docker-proxy I0905 06:07:28.297499 20829 assetstore.go:111] docker/dockerd I0905 06:07:28.297503 20829 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.01s) === RUN TestDockerBuilder_LogFlags I0905 06:07:28.300461 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.300601 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.300626 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.300653 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.300675 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.300700 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.300738 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.300755 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.300775 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.300790 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.301888 20829 zones.go:93] ListHostedZonesPages { } I0905 06:07:28.303672 20829 assetstore.go:108] Matching assets for "^docker/": I0905 06:07:28.303685 20829 assetstore.go:111] docker/containerd I0905 06:07:28.303704 20829 assetstore.go:111] docker/containerd-shim I0905 06:07:28.303709 20829 assetstore.go:111] docker/ctr I0905 06:07:28.303713 20829 assetstore.go:111] docker/docker I0905 06:07:28.303717 20829 assetstore.go:111] docker/docker-init I0905 06:07:28.303727 20829 assetstore.go:111] docker/docker-proxy I0905 06:07:28.303731 20829 assetstore.go:111] docker/dockerd I0905 06:07:28.303736 20829 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.01s) === RUN TestDockerBuilder_SkipInstall I0905 06:07:28.307183 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.307269 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.307282 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.307295 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.307306 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.307319 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.307330 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.307338 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.307348 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.307355 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.307842 20829 zones.go:93] ListHostedZonesPages { } I0905 06:07:28.308732 20829 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I0905 06:07:28.308856 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.308930 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.308942 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.308953 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.308963 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.308975 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.308987 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.308995 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.309004 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.309010 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.309509 20829 zones.go:93] ListHostedZonesPages { } I0905 06:07:28.310297 20829 assetstore.go:108] Matching assets for "^docker/": I0905 06:07:28.310306 20829 assetstore.go:111] docker/docker I0905 06:07:28.310310 20829 assetstore.go:111] docker/docker-containerd I0905 06:07:28.310313 20829 assetstore.go:111] docker/docker-containerd-ctr I0905 06:07:28.310315 20829 assetstore.go:111] docker/docker-containerd-shim I0905 06:07:28.310318 20829 assetstore.go:111] docker/docker-init I0905 06:07:28.310325 20829 assetstore.go:111] docker/docker-proxy I0905 06:07:28.310328 20829 assetstore.go:111] docker/docker-runc I0905 06:07:28.310330 20829 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.00s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I0905 06:07:28.312245 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.312330 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.312342 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.312354 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.312366 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.312379 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.312389 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.312398 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.312408 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.312416 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.313711 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.00s) === RUN TestDockerHooksBuilder I0905 06:07:28.315715 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.315831 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.315846 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.315864 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.315882 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.315901 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.315920 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.315933 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.315950 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.315960 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.317165 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.00s) === RUN TestKopsControllerBuilder I0905 06:07:28.318463 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.318544 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.318557 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.318570 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.318581 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.318595 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.318609 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.318618 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.318628 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.318636 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.319587 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.00s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I0905 06:07:28.322755 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.322841 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.322854 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.322867 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.322878 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.322892 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.322904 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.322915 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.322926 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.322933 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.323814 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.01s) === RUN TestAuditConfigAPIServerBuilder I0905 06:07:28.332223 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.332350 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.332370 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.332390 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.332404 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.332423 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.332439 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.332455 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.332480 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.332490 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.333807 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I0905 06:07:28.337525 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.337601 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.337614 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.337627 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.337638 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.337650 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.337661 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.337669 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.337679 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.337686 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.338589 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.00s) === RUN TestDeddicatedAPIServerBuilder I0905 06:07:28.342287 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.342369 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.342381 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.342394 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.342406 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.342419 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.342430 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.342438 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.342448 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.342466 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.343425 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I0905 06:07:28.352229 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.352413 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.352440 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.352468 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.352493 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.352521 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.352553 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.352566 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.352593 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.352608 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.353746 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I0905 06:07:28.357681 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.357785 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.357801 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.357819 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.357831 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.357847 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.357861 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.357870 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.357885 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.357896 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.358885 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I0905 06:07:28.363365 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:28.363451 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:28.363465 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:28.363488 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:28.363499 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:28.363512 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:28.363525 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:28.363533 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:28.363545 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:28.363553 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:28.364408 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.66s) === RUN TestKubeAPIServerBuilderARM64 I0905 06:07:30.021500 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:30.021673 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:30.021703 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:30.021739 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:30.021760 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:30.021789 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:30.021816 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:30.021833 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:30.021855 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:30.021879 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:30.023268 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.22s) === RUN TestKubeControllerManagerBuilder I0905 06:07:31.240361 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:31.240517 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:31.240545 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:31.240573 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:31.240594 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:31.240621 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:31.240645 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:31.240658 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:31.240679 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:31.240694 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:31.242396 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I0905 06:07:31.248165 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:31.248327 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:31.248352 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:31.248379 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:31.248398 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:31.248424 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:31.248445 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:31.248457 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:31.248478 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:31.248493 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:31.250077 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.21s) === RUN TestKubeControllerManagerBuilderARM64 I0905 06:07:32.463031 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:32.463232 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:32.463265 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:32.463303 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:32.463331 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:32.463371 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:32.463402 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:32.463422 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:32.463449 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:32.463469 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:32.465660 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.18s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I0905 06:07:33.648027 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:33.648204 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:33.648235 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:33.648265 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:33.648288 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:33.648318 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:33.648345 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:33.648362 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:33.648389 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:33.648408 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:33.650244 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I0905 06:07:33.655685 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:33.655803 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:33.655822 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:33.655841 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:33.655861 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:33.655882 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:33.655900 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:33.655909 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:33.655923 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:33.655934 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:33.657027 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.23s) === RUN TestKubeProxyBuilderARM64 I0905 06:07:34.888420 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:34.888602 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:34.888630 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:34.888664 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:34.888688 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:34.888717 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:34.888741 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:34.888756 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:34.888777 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:34.888808 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:34.890344 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.21s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I0905 06:07:36.098950 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:36.099160 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:36.099195 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:36.099237 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:36.099265 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:36.099300 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:36.099330 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:36.099349 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:36.099376 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:36.099396 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:36.101444 20829 zones.go:93] ListHostedZonesPages { } W0905 06:07:36.104768 20829 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I0905 06:07:36.106839 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:36.107001 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:36.107030 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:36.107059 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:36.107083 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:36.107110 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:36.107139 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:36.107158 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:36.107180 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:36.107197 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:36.109212 20829 zones.go:93] ListHostedZonesPages { } W0905 06:07:37.340143 20829 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.23s) === RUN TestKubeSchedulerBuilderARM64 I0905 06:07:37.341665 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:37.341834 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:37.341863 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:37.341892 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:37.341913 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:37.341937 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:37.341961 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:37.341974 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:37.341995 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:37.342011 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:37.343441 20829 zones.go:93] ListHostedZonesPages { } W0905 06:07:38.546370 20829 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.21s) === RUN TestKubectlBuilder I0905 06:07:38.548638 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:38.548863 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:38.548899 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:38.548939 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:38.548967 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:38.549003 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:38.549034 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:38.549054 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:38.549083 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:38.549103 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:38.551153 20829 zones.go:93] ListHostedZonesPages { } I0905 06:07:38.553529 20829 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I0905 06:07:38.556110 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:38.556262 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:38.556312 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:38.556338 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:38.556366 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:38.556395 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:38.556422 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:38.556439 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:38.556462 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:38.556478 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:38.558034 20829 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I0905 06:07:38.562581 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:38.562729 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:38.562775 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:38.562801 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:38.562828 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:38.562857 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:38.562883 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:38.562901 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:38.562923 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:38.562940 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:38.564440 20829 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.01s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I0905 06:07:38.568697 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:38.568891 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:38.568920 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:38.568947 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:38.568971 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:38.568999 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:38.569022 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:38.569039 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:38.569061 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:38.569078 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:38.571039 20829 zones.go:93] ListHostedZonesPages { } I0905 06:07:38.573292 20829 assetstore.go:108] Matching assets for "protokube$": I0905 06:07:38.573318 20829 assetstore.go:111] /opt/kops/bin/protokube I0905 06:07:38.573330 20829 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I0905 06:07:38.573354 20829 assetstore.go:108] Matching assets for "channels$": I0905 06:07:38.573363 20829 assetstore.go:111] /opt/kops/bin/channels I0905 06:07:38.573372 20829 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I0905 06:07:38.575055 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:38.575221 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:38.575250 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:38.575277 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:38.575305 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:38.575333 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:38.575360 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:38.575378 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:38.575402 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:38.575419 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:38.577344 20829 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I0905 06:07:38.580340 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:38.580509 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:38.580537 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:38.580562 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:38.580592 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:38.580628 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:38.580652 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:38.580672 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:38.580694 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:38.580711 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:38.582753 20829 zones.go:93] ListHostedZonesPages { } I0905 06:07:38.584910 20829 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.00s) === RUN TestUpdateServiceBuilderExternal I0905 06:07:38.585394 20829 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:38.585581 20829 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:38.585610 20829 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:38.585640 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:38.585665 20829 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:38.585700 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:38.585723 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:38.585743 20829 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:38.585766 20829 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:38.585784 20829 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:38.587765 20829 zones.go:93] ListHostedZonesPages { } I0905 06:07:38.589965 20829 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.00s) PASS ok k8s.io/kops/nodeup/pkg/model 10.380s ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.023s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.021s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.021s ? k8s.io/kops/pkg/apis/kops/registry [no test files] === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E0905 06:07:28.227772 20833 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E0905 06:07:28.227838 20833 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.007s ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I0905 06:07:29.530903 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.530968 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.530986 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.530998 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531018 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I0905 06:07:29.531134 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531157 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531182 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531194 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531207 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531218 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531228 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531237 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531249 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531259 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531268 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531286 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531297 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531305 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531312 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531325 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531335 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531343 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0905 06:07:29.531352 21078 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I0905 06:07:29.531435 21078 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I0905 06:07:29.531477 21078 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.065s ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.011s ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W0905 06:07:29.509771 21081 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W0905 06:07:29.510979 21081 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W0905 06:07:29.511900 21081 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W0905 06:07:29.512603 21081 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W0905 06:07:29.513312 21081 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W0905 06:07:29.513911 21081 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host W0905 06:07:29.514518 21081 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E0905 06:07:29.515195 21081 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E0905 06:07:29.515206 21081 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E0905 06:07:29.515213 21081 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E0905 06:07:29.515220 21081 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.042s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.005s ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.063s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.020s ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.094s ? k8s.io/kops/pkg/commands/commandutils [no test files] === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.094s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.025s ? k8s.io/kops/pkg/configserver [no test files] === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.005s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.005s ? k8s.io/kops/pkg/dump [no test files] === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.031s === RUN TestFlagToFalse I0905 06:07:29.496651 21280 featureflag_test.go:32] Created flag Unittest1 I0905 06:07:29.496685 21280 featureflag.go:164] FeatureFlag "UnitTest1"=false I0905 06:07:29.496691 21280 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I0905 06:07:29.496743 21280 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.004s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.024s === RUN TestRenderInstanceGroupZones W0905 06:07:29.581241 21536 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.021s === RUN TestWarmPoolOnlyRoll I0905 06:07:42.236966 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.237015 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.237025 22731 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I0905 06:07:42.237270 22731 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0905 06:07:42.237283 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.238396 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.238416 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.244105 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.244144 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.244154 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.244160 22731 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0905 06:07:42.245245 22731 instancegroups.go:431] Draining the node: "master-1a.local". I0905 06:07:42.245671 22731 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0905 06:07:42.245728 22731 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0905 06:07:42.245754 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.246860 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.246875 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.252056 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.252113 22731 instancegroups.go:431] Draining the node: "master-1b.local". I0905 06:07:42.252739 22731 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0905 06:07:42.252789 22731 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0905 06:07:42.252819 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.253926 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.253947 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.259151 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.259190 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.259203 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.259210 22731 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0905 06:07:42.260599 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.261095 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.261119 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.262238 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.262265 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.267463 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.267511 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:42.267926 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:42.267949 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.269057 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.269076 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.274476 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.274535 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:42.275151 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:42.275169 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.276286 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.276308 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.281486 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.281510 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.281519 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.281526 22731 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0905 06:07:42.281956 22731 instancegroups.go:431] Draining the node: "node-2a.local". I0905 06:07:42.282266 22731 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0905 06:07:42.282283 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.283393 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.283410 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.289035 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.289101 22731 instancegroups.go:431] Draining the node: "node-2b.local". I0905 06:07:42.289752 22731 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0905 06:07:42.289778 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.290900 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.290931 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.296133 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.296194 22731 instancegroups.go:431] Draining the node: "node-2c.local". I0905 06:07:42.296830 22731 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0905 06:07:42.296854 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.297976 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.298007 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.303204 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.303244 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I0905 06:07:42.303617 22731 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0905 06:07:42.303638 22731 instancegroups.go:469] waiting for 1ms after terminating instance W0905 06:07:42.304714 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0905 06:07:42.304742 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0905 06:07:42.304760 22731 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0905 06:07:42.304767 22731 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0905 06:07:42.304776 22731 instancegroups.go:469] waiting for 1ms after terminating instance W0905 06:07:42.305873 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0905 06:07:42.305903 22731 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0905 06:07:42.305913 22731 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0905 06:07:42.305928 22731 instancegroups.go:469] waiting for 1ms after terminating instance W0905 06:07:42.307074 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0905 06:07:42.307095 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0905 06:07:42.307114 22731 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0905 06:07:42.307126 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.307138 22731 instancegroups.go:469] waiting for 1ms after terminating instance W0905 06:07:42.308211 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0905 06:07:42.308230 22731 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0905 06:07:42.308245 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:42.308254 22731 instancegroups.go:469] waiting for 1ms after terminating instance W0905 06:07:42.309341 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0905 06:07:42.309376 22731 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0905 06:07:42.309386 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:42.309399 22731 instancegroups.go:469] waiting for 1ms after terminating instance W0905 06:07:42.310494 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0905 06:07:42.310506 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0905 06:07:42.310528 22731 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0905 06:07:42.310536 22731 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0905 06:07:42.310549 22731 instancegroups.go:469] waiting for 1ms after terminating instance W0905 06:07:42.311639 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0905 06:07:42.311667 22731 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0905 06:07:42.311679 22731 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0905 06:07:42.311691 22731 instancegroups.go:469] waiting for 1ms after terminating instance W0905 06:07:42.312778 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0905 06:07:42.312800 22731 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0905 06:07:42.312808 22731 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0905 06:07:42.312821 22731 instancegroups.go:469] waiting for 1ms after terminating instance W0905 06:07:42.314108 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0905 06:07:42.314146 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I0905 06:07:42.314424 22731 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0905 06:07:42.314445 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.315614 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.315637 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.315648 22731 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.315685 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.315692 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.315698 22731 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.315703 22731 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0905 06:07:42.316050 22731 instancegroups.go:431] Draining the node: "master-1a.local". I0905 06:07:42.316301 22731 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0905 06:07:42.316338 22731 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0905 06:07:42.316351 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.317487 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.317517 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.317532 22731 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.317559 22731 instancegroups.go:431] Draining the node: "master-1b.local". I0905 06:07:42.318020 22731 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0905 06:07:42.318061 22731 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0905 06:07:42.318078 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.319173 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.319192 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.319203 22731 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.319217 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.319228 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.319237 22731 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.319245 22731 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0905 06:07:42.319886 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.320374 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.320397 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.321526 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.321553 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.321569 22731 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.321596 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:42.322139 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:42.322165 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.323288 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.323318 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.323333 22731 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.323362 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:42.323869 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:42.323898 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.325071 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.325096 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.325109 22731 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.325123 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.325132 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.325139 22731 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.325146 22731 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0905 06:07:42.325638 22731 instancegroups.go:431] Draining the node: "node-2a.local". I0905 06:07:42.325928 22731 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0905 06:07:42.325945 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.327051 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.327076 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.327090 22731 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.327118 22731 instancegroups.go:431] Draining the node: "node-2b.local". I0905 06:07:42.327653 22731 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0905 06:07:42.327675 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.328779 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.328810 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.328819 22731 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.328839 22731 instancegroups.go:431] Draining the node: "node-2c.local". I0905 06:07:42.329220 22731 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0905 06:07:42.329241 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.330340 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.330361 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0905 06:07:42.330373 22731 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0905 06:07:42.330393 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I0905 06:07:42.330665 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I0905 06:07:42.330828 22731 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0905 06:07:42.330845 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.331949 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.331968 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.337155 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.337226 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.337240 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.337248 22731 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0905 06:07:42.337738 22731 instancegroups.go:431] Draining the node: "master-1a.local". I0905 06:07:42.338118 22731 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0905 06:07:42.338166 22731 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0905 06:07:42.338184 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.339309 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.339338 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.344525 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.344564 22731 instancegroups.go:431] Draining the node: "master-1b.local". I0905 06:07:42.344922 22731 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0905 06:07:42.344968 22731 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0905 06:07:42.344983 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.346101 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.346133 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.351338 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.351377 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.351389 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.351396 22731 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0905 06:07:42.351945 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.352362 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.352382 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.353517 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.353548 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.358694 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.358754 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:42.359237 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:42.359257 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.360327 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.360347 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.365513 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.365569 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:42.366143 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:42.366166 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.367283 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.367307 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.372505 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.372541 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.372555 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.372563 22731 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0905 06:07:42.373018 22731 instancegroups.go:431] Draining the node: "node-2a.local". I0905 06:07:42.373292 22731 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0905 06:07:42.373309 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.374416 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.374440 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.379641 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.379697 22731 instancegroups.go:431] Draining the node: "node-2b.local". I0905 06:07:42.380211 22731 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0905 06:07:42.380228 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.381367 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.381395 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.386584 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.386648 22731 instancegroups.go:431] Draining the node: "node-2c.local". I0905 06:07:42.387241 22731 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0905 06:07:42.387265 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.388392 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.388428 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.393699 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.393740 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.06s) === RUN TestRollingUpdateEmptyGroup I0905 06:07:42.393889 22731 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I0905 06:07:42.394287 22731 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0905 06:07:42.394310 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.395427 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.395447 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0905 06:07:42.395471 22731 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I0905 06:07:42.395690 22731 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0905 06:07:42.395709 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.396801 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.396815 22731 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0905 06:07:42.396823 22731 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I0905 06:07:42.396944 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.396955 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0905 06:07:42.396960 22731 instancegroups.go:509] Cluster did not validate within 0s E0905 06:07:42.396967 22731 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I0905 06:07:42.397037 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.397043 22731 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0905 06:07:42.397055 22731 instancegroups.go:509] Cluster did not validate within 0s E0905 06:07:42.397061 22731 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I0905 06:07:42.397150 22731 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0905 06:07:42.397160 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.398286 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.398315 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.403527 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.403610 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.403628 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.403637 22731 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0905 06:07:42.404539 22731 instancegroups.go:431] Draining the node: "master-1a.local". I0905 06:07:42.404994 22731 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0905 06:07:42.405044 22731 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0905 06:07:42.405065 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.406198 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.406217 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0905 06:07:42.406225 22731 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I0905 06:07:42.406380 22731 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0905 06:07:42.406391 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.407487 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.407506 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.412703 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.412771 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.412786 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.412794 22731 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0905 06:07:42.413384 22731 instancegroups.go:431] Draining the node: "master-1a.local". I0905 06:07:42.413897 22731 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0905 06:07:42.413947 22731 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0905 06:07:42.413967 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.415076 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.415097 22731 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0905 06:07:42.415123 22731 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I0905 06:07:42.416469 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.416807 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.416818 22731 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0905 06:07:42.417427 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.417886 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.417909 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.419013 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.419029 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.424154 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.424184 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:42.424568 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:42.424583 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.425678 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.425696 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.430917 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.430961 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:42.431371 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:42.431387 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.432516 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.432530 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.437739 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.437772 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I0905 06:07:42.437966 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.437977 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0905 06:07:42.437984 22731 instancegroups.go:509] Cluster did not validate within 0s E0905 06:07:42.437991 22731 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I0905 06:07:42.438094 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.438103 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0905 06:07:42.438108 22731 instancegroups.go:509] Cluster did not validate within 0s E0905 06:07:42.438113 22731 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I0905 06:07:42.438196 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.438204 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0905 06:07:42.438209 22731 instancegroups.go:509] Cluster did not validate within 0s E0905 06:07:42.438215 22731 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I0905 06:07:42.438297 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.438305 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.438309 22731 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0905 06:07:42.438697 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.438986 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.439000 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.440086 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.440099 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.445300 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.445337 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:42.445796 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:42.445814 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.446915 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.446934 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.452146 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.452194 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:42.452611 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:42.452627 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.453765 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.453778 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.458963 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.458994 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.459011 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0905 06:07:42.459025 22731 instancegroups.go:509] Cluster did not validate within 0s E0905 06:07:42.459036 22731 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I0905 06:07:42.459275 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.459293 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.459301 22731 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0905 06:07:42.459887 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.460303 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.460321 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.462153 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.462180 22731 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0905 06:07:42.462193 22731 instancegroups.go:509] Cluster did not validate within 0s E0905 06:07:42.462206 22731 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I0905 06:07:42.462359 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.462372 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.462379 22731 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0905 06:07:42.462887 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.463273 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.463291 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.464425 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.464439 22731 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0905 06:07:42.464447 22731 instancegroups.go:509] Cluster did not validate within 0s E0905 06:07:42.464454 22731 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I0905 06:07:42.464565 22731 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0905 06:07:42.464575 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.465662 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.465685 22731 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0905 06:07:42.466768 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.471924 22731 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0905 06:07:42.473033 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.478257 22731 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0905 06:07:42.479371 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.484533 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.484582 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.484592 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.484598 22731 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0905 06:07:42.484958 22731 instancegroups.go:431] Draining the node: "master-1a.local". I0905 06:07:42.485236 22731 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0905 06:07:42.485272 22731 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0905 06:07:42.485284 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.486392 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.486407 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.491572 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.491621 22731 instancegroups.go:431] Draining the node: "master-1b.local". I0905 06:07:42.492204 22731 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0905 06:07:42.492252 22731 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0905 06:07:42.492271 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.493377 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.493431 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.498637 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.498700 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.498720 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.498733 22731 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0905 06:07:42.499174 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.499479 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.499499 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.500583 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.500613 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.505801 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.505842 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:42.506367 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:42.506386 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.507484 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.507512 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.512705 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.512728 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:42.513048 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:42.513062 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.514202 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.514222 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.519422 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.519440 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.519451 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.519456 22731 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0905 06:07:42.519870 22731 instancegroups.go:431] Draining the node: "node-2a.local". I0905 06:07:42.520179 22731 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0905 06:07:42.520194 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.521303 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.521339 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.526548 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.526610 22731 instancegroups.go:431] Draining the node: "node-2b.local". I0905 06:07:42.527076 22731 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0905 06:07:42.527094 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.528215 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.528238 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.533413 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.533440 22731 instancegroups.go:431] Draining the node: "node-2c.local". I0905 06:07:42.533746 22731 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0905 06:07:42.533760 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.534867 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.534886 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.540056 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.540074 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I0905 06:07:42.540216 22731 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0905 06:07:42.540227 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.541332 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.541348 22731 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0905 06:07:42.542427 22731 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0905 06:07:42.543538 22731 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0905 06:07:42.544629 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.549858 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.549902 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.549913 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.549918 22731 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0905 06:07:42.550314 22731 instancegroups.go:431] Draining the node: "master-1a.local". I0905 06:07:42.550584 22731 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0905 06:07:42.550619 22731 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0905 06:07:42.550634 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.551746 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.551758 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.556962 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.557012 22731 instancegroups.go:431] Draining the node: "master-1b.local". I0905 06:07:42.557579 22731 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0905 06:07:42.557637 22731 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0905 06:07:42.557655 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.558763 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.558806 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.564001 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.564030 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.564039 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.564045 22731 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0905 06:07:42.564432 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.564708 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.564722 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.565858 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.565873 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.571096 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.571137 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:42.571589 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:42.571616 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.572741 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.572759 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.577965 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.577997 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:42.578399 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:42.578422 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.579570 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.579585 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.584778 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.584809 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.584818 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.584827 22731 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0905 06:07:42.585414 22731 instancegroups.go:431] Draining the node: "node-2a.local". I0905 06:07:42.585875 22731 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0905 06:07:42.585899 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.587019 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.587036 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.592167 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.592195 22731 instancegroups.go:431] Draining the node: "node-2b.local". I0905 06:07:42.592503 22731 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0905 06:07:42.592517 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.593651 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.593664 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.598835 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.598911 22731 instancegroups.go:431] Draining the node: "node-2c.local". I0905 06:07:42.599414 22731 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0905 06:07:42.599432 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.600554 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.600573 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.607998 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.608041 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I0905 06:07:42.608468 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.608479 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.608493 22731 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0905 06:07:42.608875 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.609180 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.609193 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.610287 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.610300 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.615407 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.615435 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:42.615833 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:42.615848 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.616983 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.616996 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.622207 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.622230 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I0905 06:07:42.622385 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.622395 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.622400 22731 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0905 06:07:42.622702 22731 instancegroups.go:431] Draining the node: "master-1a.local". I0905 06:07:42.622949 22731 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0905 06:07:42.622983 22731 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0905 06:07:42.622993 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.624087 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.624104 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.629297 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.629324 22731 instancegroups.go:431] Draining the node: "master-1b.local". I0905 06:07:42.629661 22731 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0905 06:07:42.629695 22731 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0905 06:07:42.629708 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.630833 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.630857 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.636053 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.636073 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I0905 06:07:42.636261 22731 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W0905 06:07:42.636278 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0905 06:07:42.636285 22731 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W0905 06:07:42.636289 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0905 06:07:42.636294 22731 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W0905 06:07:42.636299 22731 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0905 06:07:42.636306 22731 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0905 06:07:42.636312 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I0905 06:07:42.636397 22731 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I0905 06:07:42.636418 22731 instancegroups.go:203] waiting for 1ms after detaching instance I0905 06:07:42.637546 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.637558 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.642727 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.642746 22731 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I0905 06:07:42.642775 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.642784 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.642789 22731 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0905 06:07:42.643124 22731 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I0905 06:07:42.643134 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.643142 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.643146 22731 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0905 06:07:42.643513 22731 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0905 06:07:42.643541 22731 instancegroups.go:203] waiting for 1ms after detaching instance I0905 06:07:42.644651 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.644663 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.649847 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.649864 22731 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I0905 06:07:42.649870 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.649878 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.649882 22731 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0905 06:07:42.650258 22731 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I0905 06:07:42.650284 22731 instancegroups.go:203] waiting for 1ms after detaching instance I0905 06:07:42.651391 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.651402 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:42.656591 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.656608 22731 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0905 06:07:42.656620 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I0905 06:07:42.656794 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.656807 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.656813 22731 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0905 06:07:42.657548 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.657832 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.657849 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.658985 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.659019 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.659051 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:42.659058 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:42.659645 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:42.659745 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:42.659759 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.660851 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.660882 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.761264 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.761307 22731 instancegroups.go:431] Draining the node: "node-1e.local". I0905 06:07:42.761341 22731 instancegroups.go:431] Draining the node: "node-1d.local". I0905 06:07:42.761739 22731 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0905 06:07:42.761953 22731 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0905 06:07:42.761971 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.763134 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.763153 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.763168 22731 instancegroups.go:431] Draining the node: "node-1f.local". I0905 06:07:42.763481 22731 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0905 06:07:42.763497 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.764606 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.764630 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.865065 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.865128 22731 instancegroups.go:431] Draining the node: "node-1g.local". I0905 06:07:42.865867 22731 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0905 06:07:42.865910 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.867092 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.867133 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.867151 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I0905 06:07:42.867342 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.867363 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.867387 22731 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0905 06:07:42.868603 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:42.868644 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:42.869377 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:42.869543 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:42.869571 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.870751 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.870790 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.971225 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.971289 22731 instancegroups.go:431] Draining the node: "node-1d.local". I0905 06:07:42.971332 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:42.971892 22731 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0905 06:07:42.972233 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:42.972268 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.973385 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.973406 22731 instancegroups.go:540] Cluster validated. I0905 06:07:42.973421 22731 instancegroups.go:431] Draining the node: "node-1e.local". I0905 06:07:42.973727 22731 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0905 06:07:42.973744 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:42.974862 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:42.974889 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.075312 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.075367 22731 instancegroups.go:431] Draining the node: "node-1f.local". I0905 06:07:43.076083 22731 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0905 06:07:43.076125 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.077305 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.077341 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.077362 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I0905 06:07:43.077585 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.077609 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.077619 22731 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I0905 06:07:43.079043 22731 instancegroups.go:431] Draining the node: "master-1a.local". I0905 06:07:43.079626 22731 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0905 06:07:43.079670 22731 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0905 06:07:43.079698 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.080848 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.080888 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.080920 22731 instancegroups.go:431] Draining the node: "master-1c.local". I0905 06:07:43.080950 22731 instancegroups.go:431] Draining the node: "master-1b.local". I0905 06:07:43.081817 22731 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I0905 06:07:43.081863 22731 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I0905 06:07:43.082023 22731 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0905 06:07:43.082080 22731 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0905 06:07:43.082110 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.083309 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.083366 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.183838 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.183910 22731 instancegroups.go:431] Draining the node: "master-1d.local". I0905 06:07:43.183909 22731 instancegroups.go:431] Draining the node: "master-1e.local". I0905 06:07:43.184664 22731 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I0905 06:07:43.184712 22731 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I0905 06:07:43.184953 22731 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I0905 06:07:43.185006 22731 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I0905 06:07:43.185043 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.186201 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.186218 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.186233 22731 instancegroups.go:431] Draining the node: "master-1f.local". I0905 06:07:43.186489 22731 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I0905 06:07:43.186510 22731 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I0905 06:07:43.186523 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.187634 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.187679 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.288134 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.288184 22731 instancegroups.go:431] Draining the node: "master-1g.local". I0905 06:07:43.288688 22731 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I0905 06:07:43.288732 22731 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I0905 06:07:43.288757 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.289882 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.289905 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.289920 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I0905 06:07:43.290101 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.290120 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.290127 22731 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0905 06:07:43.291046 22731 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0905 06:07:43.291082 22731 instancegroups.go:203] waiting for 1ms after detaching instance I0905 06:07:43.292170 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.292193 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.292198 22731 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0905 06:07:43.292217 22731 instancegroups.go:203] waiting for 1ms after detaching instance I0905 06:07:43.293304 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.293322 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.293348 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:43.293379 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:43.293916 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:43.294031 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:43.294048 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.295182 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.295203 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.395525 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.395576 22731 instancegroups.go:431] Draining the node: "node-1d.local". I0905 06:07:43.395590 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:43.396024 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:43.396266 22731 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0905 06:07:43.396283 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.397411 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.397428 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.397442 22731 instancegroups.go:431] Draining the node: "node-1e.local". I0905 06:07:43.397728 22731 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0905 06:07:43.397745 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.398878 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.398942 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.499370 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.499424 22731 instancegroups.go:431] Draining the node: "node-1f.local". I0905 06:07:43.500062 22731 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0905 06:07:43.500098 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.501212 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.501233 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.501243 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I0905 06:07:43.501386 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.501406 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.501412 22731 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0905 06:07:43.503874 22731 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0905 06:07:43.503911 22731 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0905 06:07:43.503926 22731 instancegroups.go:203] waiting for 1ms after detaching instance I0905 06:07:43.505024 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.505048 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.505069 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:43.505141 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:43.505436 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:43.505855 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:43.505886 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.506985 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.507033 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.607261 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.607320 22731 instancegroups.go:431] Draining the node: "node-1d.local". I0905 06:07:43.607337 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:43.608301 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:43.608518 22731 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0905 06:07:43.608560 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.609673 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.609696 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.609714 22731 instancegroups.go:431] Draining the node: "node-1e.local". I0905 06:07:43.610145 22731 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0905 06:07:43.610170 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.611340 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.611397 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.711964 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.712007 22731 instancegroups.go:431] Draining the node: "node-1f.local". I0905 06:07:43.712453 22731 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0905 06:07:43.712479 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.713615 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.713647 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.713659 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I0905 06:07:43.713828 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.713838 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.713843 22731 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0905 06:07:43.714159 22731 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0905 06:07:43.714172 22731 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I0905 06:07:43.714186 22731 instancegroups.go:203] waiting for 1ms after detaching instance I0905 06:07:43.715326 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.715341 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:43.720554 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.720583 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:43.720592 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:43.720990 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:43.721008 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.721275 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:43.721288 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.722145 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.722162 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:43.727428 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.727448 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I0905 06:07:43.727573 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.727583 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.727587 22731 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0905 06:07:43.727824 22731 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E0905 06:07:43.727847 22731 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I0905 06:07:43.727864 22731 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E0905 06:07:43.727873 22731 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I0905 06:07:43.727888 22731 instancegroups.go:203] waiting for 1ms after detaching instance I0905 06:07:43.728997 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.729009 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:43.734199 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.734221 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:43.734230 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:43.734527 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:43.734541 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.734752 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:43.734765 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.735636 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.735652 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:43.740884 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.740901 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I0905 06:07:43.741056 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.741071 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.741077 22731 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I0905 06:07:43.741532 22731 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0905 06:07:43.741560 22731 instancegroups.go:203] waiting for 1ms after detaching instance I0905 06:07:43.742650 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.742667 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.742673 22731 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0905 06:07:43.742698 22731 instancegroups.go:203] waiting for 1ms after detaching instance I0905 06:07:43.743805 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.743819 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.743835 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:43.743912 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:43.743932 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:43.744137 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:43.744173 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.744792 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:43.744814 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.744923 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:43.744941 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.745288 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.845896 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.845962 22731 instancegroups.go:431] Draining the node: "node-1d.local". I0905 06:07:43.846518 22731 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0905 06:07:43.846556 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.847742 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.847776 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.847790 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I0905 06:07:43.847938 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.847954 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.847961 22731 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0905 06:07:43.849307 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:43.849645 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:43.849667 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.850772 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.850787 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.850801 22731 instancegroups.go:431] Draining the node: "node-1e.local". I0905 06:07:43.850821 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:43.851192 22731 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0905 06:07:43.851476 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:43.851495 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.852622 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.852725 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.953267 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.953336 22731 instancegroups.go:431] Draining the node: "node-1g.local". I0905 06:07:43.953378 22731 instancegroups.go:431] Draining the node: "node-1f.local". I0905 06:07:43.954167 22731 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0905 06:07:43.954304 22731 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0905 06:07:43.954329 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.955494 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.955515 22731 instancegroups.go:540] Cluster validated. I0905 06:07:43.955532 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:43.955882 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:43.955899 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:43.957054 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:43.957087 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:44.057762 22731 instancegroups.go:540] Cluster validated. I0905 06:07:44.057813 22731 instancegroups.go:431] Draining the node: "node-1d.local". I0905 06:07:44.058331 22731 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0905 06:07:44.058366 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:44.059585 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:44.059641 22731 instancegroups.go:540] Cluster validated. I0905 06:07:44.059663 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I0905 06:07:44.059877 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:44.059896 22731 instancegroups.go:540] Cluster validated. I0905 06:07:44.059908 22731 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0905 06:07:44.059927 22731 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0905 06:07:44.059936 22731 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0905 06:07:44.059955 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I0905 06:07:44.060064 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:44.060080 22731 instancegroups.go:540] Cluster validated. I0905 06:07:44.060090 22731 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0905 06:07:44.060821 22731 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0905 06:07:44.060845 22731 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0905 06:07:44.060854 22731 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0905 06:07:44.060885 22731 instancegroups.go:431] Draining the node: "node-1a.local". I0905 06:07:44.061426 22731 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0905 06:07:44.061451 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:44.062649 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:44.062675 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:44.068866 22731 instancegroups.go:540] Cluster validated. I0905 06:07:44.068929 22731 instancegroups.go:431] Draining the node: "node-1b.local". I0905 06:07:44.069664 22731 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0905 06:07:44.069694 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:44.070861 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:44.070898 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:44.076133 22731 instancegroups.go:540] Cluster validated. I0905 06:07:44.076173 22731 instancegroups.go:431] Draining the node: "node-1c.local". I0905 06:07:44.076620 22731 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0905 06:07:44.076657 22731 instancegroups.go:469] waiting for 1ms after terminating instance I0905 06:07:44.077829 22731 instancegroups.go:504] Validating the cluster. I0905 06:07:44.077856 22731 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0905 06:07:44.083082 22731 instancegroups.go:540] Cluster validated. I0905 06:07:44.083123 22731 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 1.922s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.003s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.013s === RUN TestParse E0905 06:07:42.177756 22734 versions.go:96] unable to parse Kubernetes version "" E0905 06:07:42.177813 22734 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.009s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.039s ? k8s.io/kops/pkg/kopscontrollerclient [no test files] === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.11s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.175s ? k8s.io/kops/pkg/kubemanifest [no test files] === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.082s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.065s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.070s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I0905 06:07:42.229043 22740 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.064s ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] === RUN Test_RunEtcdManagerBuilder I0905 06:07:42.233834 22743 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W0905 06:07:42.261117 22743 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W0905 06:07:42.262289 22743 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.03s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.00s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.00s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.097s ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] === RUN Test_RunKubeApiserverBuilder I0905 06:07:42.233589 22747 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.075s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.081s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.028s ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.074s === RUN TestServerGroupBuilder I0905 06:07:42.240657 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.249736 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.259985 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.276921 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.282260 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.293148 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.304471 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.314835 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.326840 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.337353 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.342746 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.349838 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.357535 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.362839 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.368259 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.423467 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.428366 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:42.432727 22755 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.20s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.271s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.032s ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.034s ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.024s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.00s) --- PASS: TestGenerateCertificate/selfsigned (0.00s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (0.42s) --- PASS: TestIssueCert/ca (0.17s) --- PASS: TestIssueCert/client (0.12s) --- PASS: TestIssueCert/clientOneYear (0.12s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 0.427s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.004s ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] === RUN TestAddUntaggedRouteTables I0905 06:07:46.989634 24467 routetable.go:53] DescribeRouteTables: { } I0905 06:07:46.989721 24467 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") W0905 06:07:46.989730 24467 tags.go:67] cluster tag not found on route-table:rtb-1234 --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I0905 06:07:46.989801 24467 iaminstanceprofile.go:193] ListInstanceProfiles: { } W0905 06:07:46.989855 24467 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I0905 06:07:46.989901 24467 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I0905 06:07:46.989951 24467 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I0905 06:07:46.989989 24467 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I0905 06:07:46.990033 24467 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I0905 06:07:46.990089 24467 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I0905 06:07:46.990105 24467 volumes.go:128] DescribeVolumes: { } W0905 06:07:46.990123 24467 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I0905 06:07:46.990211 24467 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:46.990329 24467 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:46.990355 24467 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:46.990401 24467 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:46.990416 24467 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:46.990446 24467 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:46.990467 24467 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:46.990475 24467 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:46.990493 24467 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:46.990511 24467 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:46.990522 24467 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I0905 06:07:46.990534 24467 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I0905 06:07:46.990544 24467 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I0905 06:07:46.990559 24467 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I0905 06:07:46.990569 24467 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I0905 06:07:46.990584 24467 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I0905 06:07:46.990600 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I0905 06:07:46.990612 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I0905 06:07:46.990622 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I0905 06:07:46.990631 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I0905 06:07:46.990640 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I0905 06:07:46.990651 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I0905 06:07:46.990667 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I0905 06:07:46.990675 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I0905 06:07:46.990685 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I0905 06:07:46.990693 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I0905 06:07:46.990702 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I0905 06:07:46.990710 24467 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.050s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.027s ? k8s.io/kops/pkg/resources/digitalocean [no test files] === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.053s ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.005s ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.004s ? k8s.io/kops/pkg/try [no test files] === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.004s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.004s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.005s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.00s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.035s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.066s ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.005s ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] === RUN TestRemovesDuplicateGuardedBlocks W0905 06:07:47.096849 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.096907 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.096913 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.096919 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.096925 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.096930 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.096936 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.096941 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.096945 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.096950 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.096955 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.096960 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.096964 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.096970 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.096975 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.096981 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.108544 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.108572 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.108640 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.108649 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.108706 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.108714 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.108763 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.108771 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.108835 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.108844 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.108913 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.108923 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.108972 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.108980 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109046 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109059 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109109 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109118 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109191 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109200 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109253 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109261 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109309 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109317 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109365 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109373 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109422 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109430 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109480 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109488 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109538 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109546 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109594 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109602 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109651 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109659 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109707 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109714 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109793 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109802 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109853 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109862 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109913 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109921 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.109969 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.109976 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110025 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110033 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110082 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110090 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110138 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110146 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110196 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110204 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110253 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110261 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110310 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110331 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110388 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110396 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110447 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110460 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110511 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110519 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110567 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110575 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110624 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110632 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110692 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110701 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110767 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110776 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110853 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110862 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110913 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110921 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.110970 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.110978 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111027 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111035 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111099 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111114 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111167 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111175 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111225 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111233 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111284 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111294 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111347 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111366 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111419 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111427 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111480 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111489 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111540 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111548 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111633 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111645 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111697 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111706 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111757 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111765 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111816 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111825 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111880 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111889 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111939 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.111948 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.111998 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.112006 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.112057 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.112065 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.112115 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.112198 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.112817 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.112829 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.112882 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.112891 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.112940 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.112948 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.112999 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113007 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113054 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113062 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113140 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113150 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113208 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113218 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113266 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113274 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113324 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113333 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113387 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113396 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113445 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113453 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113500 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113507 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113553 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113561 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113604 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113615 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113663 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113669 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113716 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113723 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113770 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113779 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113824 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113831 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113911 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113922 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.113973 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.113981 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114042 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114053 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114117 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114126 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114189 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114199 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114256 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114266 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114324 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114334 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114390 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114399 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114476 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114486 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114539 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114547 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114595 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114601 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114647 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114657 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114708 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114717 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114765 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114773 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114823 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114833 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114886 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114895 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.114947 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.114956 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.115004 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.115012 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.115060 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.115069 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.115120 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.115128 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.115180 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.115189 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.115241 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.115249 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.115310 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.115323 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.115374 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.115381 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.02s) === RUN TestRecoversFromBadNesting W0905 06:07:47.116047 24798 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0905 06:07:47.116057 24798 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0905 06:07:47.116063 24798 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0905 06:07:47.116067 24798 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0905 06:07:47.116072 24798 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0905 06:07:47.116076 24798 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0905 06:07:47.116080 24798 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0905 06:07:47.116102 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.116111 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.116118 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.116124 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.116130 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.116136 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.116144 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.116149 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.116155 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.116160 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.116166 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.116171 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.116176 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.116181 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.116187 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.116193 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135074 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135102 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135170 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135182 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135236 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135246 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135307 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135317 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135403 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135412 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135478 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135488 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135540 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135548 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135605 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135615 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135666 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135675 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135727 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135735 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135787 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135796 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135847 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135858 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135929 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.135939 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.135994 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136003 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136054 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136064 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136154 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136164 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136235 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136244 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136296 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136304 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136352 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136359 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136413 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136421 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136472 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136480 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136528 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136537 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136591 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136601 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136656 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136664 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136711 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136719 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136771 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136779 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136831 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136840 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136891 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136900 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.136971 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.136980 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137029 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137038 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137086 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137095 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137143 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137151 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137200 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137208 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137255 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137263 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137314 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137323 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137378 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137394 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137449 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137457 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137506 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137514 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137573 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137582 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137640 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137649 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137699 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137707 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137759 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137769 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137818 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137827 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137877 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137886 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137938 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.137949 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.137998 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138007 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138056 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138066 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138113 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138121 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138169 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138177 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138224 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138232 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138280 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138288 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138338 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138346 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138392 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138400 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138464 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138473 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138525 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138533 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138583 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138591 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138639 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138649 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138698 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138706 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138757 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138765 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138830 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138840 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138894 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138903 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.138953 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.138961 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139013 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139021 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139070 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139079 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139126 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139139 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139187 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139198 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139247 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139255 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139307 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139315 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139378 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139390 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139440 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139450 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139509 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139518 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139571 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139580 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139629 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139636 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139687 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139693 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139742 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139750 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139802 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139814 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139866 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139874 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.139942 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.139952 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140003 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140010 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140062 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140069 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140118 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140126 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140192 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140201 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140257 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140265 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140329 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140339 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140399 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140409 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140467 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140477 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140538 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140546 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140617 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140625 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140678 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140686 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140737 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140744 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140795 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140805 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140863 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140874 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140928 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.140938 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.140999 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.141010 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.141062 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.141070 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.141120 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.141133 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.141182 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.141189 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.141238 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.141246 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0905 06:07:47.141298 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0905 06:07:47.141307 24798 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.03s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.049s ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.00s) PASS ok k8s.io/kops/tests/codecs 0.037s ? k8s.io/kops/tests/fuzz [no test files] === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.00s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.055s ? k8s.io/kops/tests/integration/channel/simple [no test files] === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.01s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.01s) PASS ok k8s.io/kops/tests/integration/conversion 0.027s ? k8s.io/kops/upup/models [no test files] === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I0905 06:07:49.533198 26801 files.go:57] Writing file "/tmp/TestWriteFile1041533680/001/SubDir/test1.tmp" I0905 06:07:49.533468 26801 files.go:113] Changing file mode for "/tmp/TestWriteFile1041533680/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.028s === RUN TestBootstrapChannelBuilder_BuildTasks I0905 06:07:53.799708 27113 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:53.799871 27113 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:53.799899 27113 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:53.799928 27113 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:53.799943 27113 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:53.799974 27113 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:53.799996 27113 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:53.800002 27113 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:53.800030 27113 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:53.800045 27113 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:53.804735 27113 zones.go:93] ListHostedZonesPages { } I0905 06:07:53.863145 27113 zones.go:93] ListHostedZonesPages { } I0905 06:07:53.958731 27113 zones.go:93] ListHostedZonesPages { } I0905 06:07:54.087723 27113 zones.go:93] ListHostedZonesPages { } I0905 06:07:54.229241 27113 zones.go:93] ListHostedZonesPages { } I0905 06:07:54.329996 27113 zones.go:93] ListHostedZonesPages { } I0905 06:07:54.429614 27113 zones.go:93] ListHostedZonesPages { } I0905 06:07:54.578146 27113 zones.go:93] ListHostedZonesPages { } I0905 06:07:55.156094 27113 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.48s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I0905 06:07:55.283959 27113 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:55.284161 27113 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:55.284224 27113 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:55.284267 27113 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:55.284299 27113 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:55.284339 27113 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:55.284372 27113 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:55.284391 27113 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:55.284419 27113 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:55.284440 27113 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:55.284464 27113 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I0905 06:07:55.285864 27113 zones.go:93] ListHostedZonesPages { } I0905 06:07:55.445790 27113 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.16s) === RUN TestBootstrapChannelBuilder_AWSCloudController I0905 06:07:55.446050 27113 featureflag.go:164] FeatureFlag "ImageDigest"=false I0905 06:07:55.446237 27113 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:55.446297 27113 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0905 06:07:55.446335 27113 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0905 06:07:55.446363 27113 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0905 06:07:55.446399 27113 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0905 06:07:55.446430 27113 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0905 06:07:55.446449 27113 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0905 06:07:55.446475 27113 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0905 06:07:55.446495 27113 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0905 06:07:55.447888 27113 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.13s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.18s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W0905 06:07:55.778357 27113 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I0905 06:07:55.821351 27113 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I0905 06:07:55.821417 27113 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I0905 06:07:55.821433 27113 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I0905 06:07:55.821515 27113 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I0905 06:07:55.821529 27113 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I0905 06:07:55.821593 27113 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I0905 06:07:55.821656 27113 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I0905 06:07:55.821717 27113 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0905 06:07:55.821734 27113 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I0905 06:07:55.821794 27113 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0905 06:07:55.821811 27113 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I0905 06:07:55.821906 27113 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I0905 06:07:55.822004 27113 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I0905 06:07:55.822068 27113 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I0905 06:07:55.822078 27113 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I0905 06:07:55.822087 27113 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I0905 06:07:55.822104 27113 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I0905 06:07:55.822114 27113 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I0905 06:07:55.822140 27113 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I0905 06:07:55.822150 27113 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I0905 06:07:55.822163 27113 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I0905 06:07:55.823415 27113 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I0905 06:07:55.823625 27113 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.116s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I0905 06:07:53.786243 27115 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender217473416/001 I0905 06:07:53.786536 27115 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender217473416/001 I0905 06:07:53.786778 27115 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender217473416/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I0905 06:07:53.789421 27115 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0905 06:07:53.789493 27115 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0905 06:07:53.789533 27115 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I0905 06:07:53.789598 27115 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0905 06:07:53.789663 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.789703 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.789714 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.789799 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:07:53.789818 27115 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0905 06:07:53.789838 27115 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0905 06:07:53.789881 27115 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0905 06:07:53.789929 27115 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0905 06:07:53.789961 27115 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0905 06:07:53.789983 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.790004 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.790012 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.790030 27115 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0905 06:07:53.790050 27115 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0905 06:07:53.790079 27115 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I0905 06:07:53.790155 27115 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0905 06:07:53.790197 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.790244 27115 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0905 06:07:53.790261 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:07:53.790274 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.790290 27115 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0905 06:07:53.790328 27115 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0905 06:07:53.790422 27115 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0905 06:07:53.790450 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:07:53.790462 27115 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:07:53.790476 27115 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0905 06:07:53.790515 27115 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:07:53.790584 27115 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I0905 06:07:53.790615 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:07:53.790626 27115 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I0905 06:07:53.790646 27115 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0905 06:07:53.790681 27115 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0905 06:07:53.790703 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.790728 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.790736 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.790750 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.790763 27115 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0905 06:07:53.790783 27115 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0905 06:07:53.790811 27115 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:07:53.790825 27115 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0905 06:07:53.790844 27115 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:07:53.790868 27115 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I0905 06:07:53.790882 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0905 06:07:53.790901 27115 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I0905 06:07:53.790949 27115 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0905 06:07:53.790967 27115 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0905 06:07:53.790979 27115 internetgateways.go:66] CreateInternetGateway: { } I0905 06:07:53.790987 27115 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I0905 06:07:53.791014 27115 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0905 06:07:53.791037 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.791057 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.791063 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.791094 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:07:53.791108 27115 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0905 06:07:53.791123 27115 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0905 06:07:53.791157 27115 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0905 06:07:53.791203 27115 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0905 06:07:53.791231 27115 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0905 06:07:53.791252 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.791272 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.791280 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.791296 27115 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0905 06:07:53.791316 27115 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0905 06:07:53.791345 27115 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I0905 06:07:53.791706 27115 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender588081629/001 I0905 06:07:53.791940 27115 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender588081629/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I0905 06:07:53.792252 27115 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0905 06:07:53.792279 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.792328 27115 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0905 06:07:53.792346 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:07:53.792356 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.792369 27115 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0905 06:07:53.792409 27115 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0905 06:07:53.792522 27115 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I0905 06:07:53.792552 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0905 06:07:53.792590 27115 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0905 06:07:53.792623 27115 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0905 06:07:53.792646 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.792669 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.792676 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.792688 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.792701 27115 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0905 06:07:53.792722 27115 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0905 06:07:53.792759 27115 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I0905 06:07:53.792877 27115 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0905 06:07:53.792900 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.792942 27115 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0905 06:07:53.792959 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:07:53.792969 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.792982 27115 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0905 06:07:53.793001 27115 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0905 06:07:53.793044 27115 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0905 06:07:53.793072 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:07:53.793089 27115 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:07:53.793103 27115 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0905 06:07:53.793135 27115 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0905 06:07:53.793157 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.793178 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.793185 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.793196 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.793208 27115 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0905 06:07:53.793240 27115 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0905 06:07:53.793266 27115 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:07:53.793287 27115 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I0905 06:07:53.793378 27115 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0905 06:07:53.793401 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.793442 27115 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0905 06:07:53.793460 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:07:53.793470 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.793483 27115 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0905 06:07:53.793507 27115 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0905 06:07:53.793581 27115 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0905 06:07:53.793613 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:07:53.793625 27115 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:07:53.793665 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.793809 27115 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0905 06:07:53.793843 27115 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0905 06:07:53.793905 27115 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0905 06:07:53.793935 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.793963 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.793972 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.793987 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.794000 27115 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0905 06:07:53.794029 27115 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0905 06:07:53.794065 27115 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:07:53.794076 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.794099 27115 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I0905 06:07:53.794175 27115 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0905 06:07:53.794197 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.794243 27115 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0905 06:07:53.794266 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:07:53.794279 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.794292 27115 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0905 06:07:53.794313 27115 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0905 06:07:53.794364 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.794444 27115 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0905 06:07:53.794486 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:07:53.794501 27115 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:07:53.794513 27115 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0905 06:07:53.794526 27115 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0905 06:07:53.794576 27115 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0905 06:07:53.794599 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.794621 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.794629 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.794641 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.794653 27115 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0905 06:07:53.794674 27115 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0905 06:07:53.794749 27115 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:07:53.794763 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.794816 27115 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I0905 06:07:53.794891 27115 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I0905 06:07:53.794937 27115 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I0905 06:07:53.794990 27115 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0905 06:07:53.795016 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.795054 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.795061 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.795099 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:07:53.795118 27115 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0905 06:07:53.795136 27115 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0905 06:07:53.795158 27115 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:07:53.795228 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0905 06:07:53.795243 27115 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0905 06:07:53.795258 27115 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0905 06:07:53.795310 27115 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0905 06:07:53.795332 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.795352 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.795359 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.795377 27115 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0905 06:07:53.795398 27115 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0905 06:07:53.795426 27115 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I0905 06:07:53.795486 27115 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.795510 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.795552 27115 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0905 06:07:53.795569 27115 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0905 06:07:53.795580 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.795592 27115 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0905 06:07:53.795622 27115 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.795645 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0905 06:07:53.795674 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.795682 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.795694 27115 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0905 06:07:53.795706 27115 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I0905 06:07:53.795777 27115 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I0905 06:07:53.795809 27115 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.795837 27115 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I0905 06:07:53.795859 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0905 06:07:53.795865 27115 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0905 06:07:53.795881 27115 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.058s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.042s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.030s === RUN TestDiskRenderAzure I0905 06:07:53.770614 27117 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I0905 06:07:53.770894 27117 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I0905 06:07:53.771052 27117 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I0905 06:07:53.771513 27117 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I0905 06:07:53.771667 27117 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I0905 06:07:53.772105 27117 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I0905 06:07:53.772264 27117 resourcegroup.go:108] Creating a new Resource Group with name: rg I0905 06:07:53.772272 27117 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I0905 06:07:53.772390 27117 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I0905 06:07:53.772765 27117 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I0905 06:07:53.772942 27117 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I0905 06:07:53.773066 27117 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I0905 06:07:53.773248 27117 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I0905 06:07:53.773407 27117 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.036s ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.028s ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] === RUN TestProjectIAMBinding I0905 06:07:53.785380 27119 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.785790 27119 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0905 06:07:53.785807 27119 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.787536 27119 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0905 06:07:53.787947 27119 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.788152 27119 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I0905 06:07:53.788255 27119 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.788317 27119 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0905 06:07:53.788329 27119 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.788395 27119 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0905 06:07:53.788408 27119 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.788434 27119 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I0905 06:07:53.788491 27119 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.788643 27119 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0905 06:07:53.788656 27119 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.788874 27119 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0905 06:07:53.788890 27119 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0905 06:07:53.788963 27119 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.052s ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.051s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.041s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.028s ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.026s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.006s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.027s ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I0905 06:07:53.794763 27127 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I0905 06:07:53.794841 27127 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I0905 06:07:53.794855 27127 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I0905 06:07:53.794867 27127 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I0905 06:07:53.794879 27127 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I0905 06:07:53.794889 27127 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I0905 06:07:53.794899 27127 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W0905 06:07:53.795359 27127 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.058s ? k8s.io/kops/upup/pkg/fi/secrets [no test files] === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.006s ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.005s ? k8s.io/kops/util/pkg/env [no test files] === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.005s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.005s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.006s ? k8s.io/kops/util/pkg/mirrors [no test files] === RUN TestGetProxyEnvVars W0905 06:07:53.759564 27133 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.020s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.033s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.006s ? k8s.io/kops/util/pkg/tables [no test files] === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.004s ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.030s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W0905 06:07:57.805495 27586 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.053s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... kubernetes >>> kops*: Package size: 146.5 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.4-r13.apk >>> kops: Build complete at Fri, 05 Sep 2025 06:09:28 +0000 elapsed time 0h 3m 37s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/4) Purging .makedepends-kops (20250905.060552) (2/4) Purging kubernetes (1.33.4-r1) (3/4) Purging go (1.25.1-r0) (4/4) Purging bash (5.3.3-r1) bash-5.3.3-r1.pre-deinstall: Executing script... busybox-1.37.0-r23.trigger: Executing script... OK: 441 MiB in 106 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...