>>> kops: Building testing/kops 1.28.4-r10 (using abuild 3.15.0_rc3-r3) started Tue, 13 May 2025 07:30:44 +0000 >>> kops: Validating /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/4) Installing kubernetes (1.32.2-r3) (2/4) Installing go (1.24.3-r1) (3/4) Installing bash (5.2.37-r0) Executing bash-5.2.37-r0.post-install (4/4) Installing .makedepends-kops (20250513.073046) Executing busybox-1.37.0-r17.trigger OK: 595 MiB in 110 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz Connecting to distfiles.alpinelinux.org (172.105.82.32:443) saving to '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' kops-1.28.4.tar.gz.p 100% |********************************| 32.7M 0:00:00 ETA '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' saved >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz >>> kops: Checking sha512sums... kops-1.28.4.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.4.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.4 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading golang.org/x/crypto v0.14.0 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/spf13/pflag v1.0.5 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading go.uber.org/multierr v1.11.0 go: downloading k8s.io/apimachinery v0.28.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading k8s.io/client-go v0.28.1 go: downloading github.com/spf13/cobra v1.7.0 go: downloading k8s.io/api v0.28.1 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading k8s.io/kubectl v0.28.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading k8s.io/klog v1.0.0 go: downloading golang.org/x/net v0.17.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/google/uuid v1.3.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/gogo/protobuf v1.3.2 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading github.com/google/gofuzz v1.2.0 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading github.com/pkg/errors v0.9.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading golang.org/x/sys v0.13.0 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading github.com/kr/fs v0.1.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading golang.org/x/term v0.13.0 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading golang.org/x/text v0.13.0 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading google.golang.org/protobuf v1.31.0 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/google/s2a-go v0.1.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/gorilla/mux v1.8.0 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/docker/go-metrics v0.0.1 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/moby/locker v1.0.1 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I0513 07:32:17.541446 14405 addon.go:250] addon test wants to update all nodes I0513 07:32:17.542694 14405 addon.go:250] addon test wants to update workers nodes I0513 07:32:17.542922 14405 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I0513 07:32:17.543249 14405 addon.go:283] installing PKI for "test" I0513 07:32:17.863499 14405 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.47s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.514s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.042s ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN TestCreateClusterMinimal I0513 07:32:18.673439 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:18.673637 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:18.673665 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:18.673702 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:18.673717 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:18.673754 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:18.673778 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:18.673787 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:18.673809 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:18.673826 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:18.679218 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:18.679251 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:18.771531 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:18.771674 15421 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0513 07:32:18.771954 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:18.783780 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:18.783935 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:18.783962 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:18.783989 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:18.784009 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:18.784037 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:18.784061 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:18.784075 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:18.784097 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:18.784111 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:18.787087 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:18.787124 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:18.819907 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:18.820008 15421 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0513 07:32:18.820207 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:18.824700 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:18.825037 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:18.825071 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:18.825541 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:18.825604 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:18.825642 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:18.825664 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:18.825674 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:18.825691 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:18.825705 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:18.828237 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:18.828262 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:18.915993 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:18.916103 15421 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0513 07:32:18.916308 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:18.919828 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:18.919926 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:18.919944 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:18.919964 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:18.919980 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:18.919999 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:18.920016 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:18.920026 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:18.920041 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:18.920052 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:18.969084 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:18.969123 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.078337 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:19.078443 15421 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0513 07:32:19.078651 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:19.082115 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.082219 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.082246 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.082267 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.082279 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.082297 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.082312 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.082320 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.082333 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.082345 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.084420 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.084445 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.172427 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:19.172534 15421 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0513 07:32:19.172731 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:19.179665 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.179788 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.179809 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.179832 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.179846 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.179866 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.179885 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.179895 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.179909 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.179920 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.182366 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.182401 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.284236 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:19.284315 15421 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0513 07:32:19.284521 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:19.288007 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.288101 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.288119 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.288140 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.288154 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.288172 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.288189 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.288197 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.288212 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.288222 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.291081 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.291109 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.361789 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:19.361930 15421 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0513 07:32:19.362155 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.69s) === RUN TestCreateClusterHetzner I0513 07:32:19.365895 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.366007 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.366025 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.366051 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.366064 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.366081 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.366099 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.366108 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.366124 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.366135 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.368717 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.368775 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0513 07:32:19.389968 15421 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0513 07:32:19.389994 15421 new_cluster.go:1373] Cloud Provider ID: "hetzner" I0513 07:32:19.395336 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.395447 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.395475 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.395497 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.395512 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.395530 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.395548 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.395563 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.395577 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.395588 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.440435 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.440475 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.494091 15421 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.13s) === RUN TestCreateClusterOpenStack I0513 07:32:19.499286 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.499435 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.499460 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.499491 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.499510 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.499535 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.499558 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.499572 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.499591 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.499605 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.502001 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.502031 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0513 07:32:19.515597 15421 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0513 07:32:19.515626 15421 new_cluster.go:1373] Cloud Provider ID: "openstack" I0513 07:32:19.516880 15421 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.02s) === RUN TestCreateClusterOpenStackOctavia I0513 07:32:19.522293 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.522448 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.522474 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.522511 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.522531 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.522557 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.522579 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.522594 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.522618 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.522632 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.524971 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.524995 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0513 07:32:19.605163 15421 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0513 07:32:19.605202 15421 new_cluster.go:1373] Cloud Provider ID: "openstack" I0513 07:32:19.606240 15421 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0513 07:32:19.606263 15421 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.09s) === RUN TestCreateClusterOpenStackNoDNS I0513 07:32:19.610904 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.611001 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.611019 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.611039 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.611053 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.611077 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.611092 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.611100 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.611113 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.611123 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.613319 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.613347 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0513 07:32:19.628918 15421 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0513 07:32:19.628940 15421 new_cluster.go:1373] Cloud Provider ID: "openstack" I0513 07:32:19.628970 15421 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0513 07:32:19.628979 15421 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.02s) === RUN TestCreateClusterCilium I0513 07:32:19.635423 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.635585 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.635608 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.635631 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.635648 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.635671 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.635690 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.635702 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.635718 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.635733 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.640703 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.640741 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.667540 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:19.667675 15421 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0513 07:32:19.667930 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.04s) === RUN TestCreateClusterOverride I0513 07:32:19.671524 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.671623 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.671641 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.671670 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.671686 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.671703 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.671724 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.671732 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.671747 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.671757 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.674953 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.675009 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.734828 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:19.735168 15421 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0513 07:32:19.735414 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.07s) === RUN TestCreateClusterKubernetesFeatureGates I0513 07:32:19.739041 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.739143 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.739161 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.739186 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.739201 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.739220 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.739240 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.739249 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.739262 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.739274 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.741462 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.741506 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.846103 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:19.846227 15421 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0513 07:32:19.846494 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.11s) === RUN TestCreateClusterComplex I0513 07:32:19.850637 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.850740 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.850760 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.850779 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.850795 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.850813 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.850831 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.850841 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.850854 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.850864 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.854224 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.854273 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.894545 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:19.894736 15421 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I0513 07:32:19.894743 15421 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I0513 07:32:19.894747 15421 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I0513 07:32:19.894983 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.06s) === RUN TestCreateClusterComplexPrivate I0513 07:32:19.907527 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:19.907753 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:19.907789 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:19.907833 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:19.907862 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:19.907898 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:19.907929 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:19.907949 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:19.907976 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:19.907996 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:19.912388 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.912456 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:19.998025 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:19.998314 15421 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I0513 07:32:19.998322 15421 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I0513 07:32:19.998326 15421 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I0513 07:32:19.998329 15421 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I0513 07:32:19.998332 15421 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I0513 07:32:19.998334 15421 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I0513 07:32:19.998337 15421 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I0513 07:32:19.998344 15421 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I0513 07:32:19.998348 15421 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I0513 07:32:19.998351 15421 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I0513 07:32:19.998668 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.10s) === RUN TestCreateClusterHA I0513 07:32:20.006439 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.006553 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.006572 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.006591 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.006604 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.006624 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.006644 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.006653 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.006667 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.006677 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.036606 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.036652 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.099431 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:20.099646 15421 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0513 07:32:20.099653 15421 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0513 07:32:20.099657 15421 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0513 07:32:20.099886 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:20.105384 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.105477 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.105494 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.105514 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.105527 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.105547 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.105566 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.105576 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.105590 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.105601 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.109326 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.109353 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.122044 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:20.122229 15421 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0513 07:32:20.122237 15421 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0513 07:32:20.122240 15421 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0513 07:32:20.122443 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.13s) === RUN TestCreateClusterMinimalGCE I0513 07:32:20.135722 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.135921 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.135956 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.136003 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.136033 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.136067 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.136102 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.136122 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.136150 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.136170 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.139260 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.139296 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.267373 15421 new_cluster.go:1373] Cloud Provider ID: "gce" I0513 07:32:20.267463 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I0513 07:32:20.270971 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.271084 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.271103 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.271124 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.271137 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.271155 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.271173 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.271181 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.271196 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.271207 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.273716 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.273743 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.304321 15421 new_cluster.go:1373] Cloud Provider ID: "gce" I0513 07:32:20.304399 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.17s) === RUN TestCreateClusterHAGCE I0513 07:32:20.308002 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.308108 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.308128 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.308146 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.308161 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.308179 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.308197 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.308207 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.308221 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.308231 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.311187 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.311253 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.330279 15421 new_cluster.go:1373] Cloud Provider ID: "gce" I0513 07:32:20.330476 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.03s) === RUN TestCreateClusterGCE I0513 07:32:20.341699 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.341944 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.341993 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.342055 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.342099 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.342161 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.342209 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.342257 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.342311 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.342348 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.345447 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.345475 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.376092 15421 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0513 07:32:20.376169 15421 new_cluster.go:1373] Cloud Provider ID: "gce" I0513 07:32:20.376231 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.04s) === RUN TestCreateClusterHASharedZone I0513 07:32:20.386392 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.386599 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.386635 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.386675 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.386704 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.386741 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.386774 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.386794 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.386821 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.386842 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.391611 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.391663 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0513 07:32:20.486818 15421 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0513 07:32:20.486861 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:20.487007 15421 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0513 07:32:20.487231 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.11s) === RUN TestCreateClusterHASharedZones I0513 07:32:20.491898 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.492009 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.492027 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.492048 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.492065 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.492084 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.492103 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.492112 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.492127 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.492139 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.495888 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.495941 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0513 07:32:20.564791 15421 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0513 07:32:20.564847 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:20.565163 15421 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I0513 07:32:20.565183 15421 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I0513 07:32:20.565537 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.08s) === RUN TestCreateClusterPrivate I0513 07:32:20.573830 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.573977 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.574003 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.574043 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.574070 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.574115 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.574144 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.574166 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.574197 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.574216 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.577787 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.577819 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.690827 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:20.691013 15421 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0513 07:32:20.691028 15421 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0513 07:32:20.691293 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:20.691321 15421 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.12s) === RUN TestCreateClusterPrivateGCE I0513 07:32:20.698431 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.698634 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.698663 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.698688 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.698706 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.698728 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.698751 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.698761 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.698778 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.698795 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.703468 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.703498 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.758499 15421 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0513 07:32:20.759089 15421 new_cluster.go:1373] Cloud Provider ID: "gce" I0513 07:32:20.759210 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.07s) === RUN TestCreateClusterWithNGWSpecified I0513 07:32:20.768656 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.768837 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.768868 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.768904 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.768933 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.768965 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.768990 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.769007 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.769034 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.769052 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.772801 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.772851 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.812543 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:20.812742 15421 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0513 07:32:20.812763 15421 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0513 07:32:20.813004 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:20.813035 15421 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.05s) === RUN TestCreateClusterWithINGWSpecified I0513 07:32:20.820016 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.820153 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.820178 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.820199 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.820219 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.820241 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.820261 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.820277 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.820295 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.820308 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.823931 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.823979 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.877126 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:20.877345 15421 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0513 07:32:20.877369 15421 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0513 07:32:20.877635 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:20.877668 15421 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.07s) === RUN TestCreateClusterSharedVPC I0513 07:32:20.893355 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.893481 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.893505 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.893525 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.893544 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.893567 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.893588 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.893603 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.893619 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.893632 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.897168 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.897223 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.947161 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:20.947344 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:20.947418 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:20.947464 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:20.947482 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:20.947528 15421 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I0513 07:32:20.947866 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.06s) === RUN TestCreateClusterSharedSubnets I0513 07:32:20.954456 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:20.954626 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:20.954657 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:20.954687 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:20.954712 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:20.954741 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:20.954767 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:20.954781 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:20.954803 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:20.954822 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:20.959270 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:20.959323 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:21.072633 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:21.072671 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:21.072725 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:21.072818 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:21.072830 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:21.072842 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:21.072849 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:21.073047 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.12s) === RUN TestCreateClusterSharedSubnetsVpcLookup I0513 07:32:21.076529 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:21.076630 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:21.076648 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:21.076664 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:21.076677 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:21.076704 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:21.076721 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:21.076728 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:21.076742 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:21.076757 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:21.080657 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:21.080710 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:21.289987 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:32:21.290036 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:21.290051 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:21.290118 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:21.290217 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:21.290230 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:21.290245 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:21.290256 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:21.290546 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.22s) === RUN TestCreateClusterPrivateSharedSubnets I0513 07:32:21.294676 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:21.294795 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:21.294814 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:21.294833 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:21.294847 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:21.294867 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:21.294888 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:21.294897 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:21.294913 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:21.294926 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:21.298328 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:21.298361 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:21.351995 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:21.352033 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:21.352080 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:21.352090 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:21.352133 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:21.352245 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:21.352259 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:21.352283 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:32:21.352293 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:32:21.352576 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.06s) === RUN TestCreateClusterIPv6 I0513 07:32:21.357330 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:21.357449 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:21.357471 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:21.357493 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:21.357510 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:21.357533 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:21.357561 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:21.357572 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:21.357588 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:21.357600 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:21.360946 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:21.360999 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:21.451364 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:21.451505 15421 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I0513 07:32:21.451518 15421 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I0513 07:32:21.451899 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.10s) === RUN TestCreateClusterDifferentAMIs I0513 07:32:21.456428 15421 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0513 07:32:21.456438 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:21.456545 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:21.456566 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:21.456588 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:21.456604 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:21.456626 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:21.456647 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:21.456657 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:21.456674 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:21.456686 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:21.459329 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:21.459357 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:21.473348 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:21.473484 15421 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0513 07:32:21.473500 15421 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0513 07:32:21.473901 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:21.480568 15421 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.02s) === RUN TestCreateClusterKarpenter I0513 07:32:21.480679 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:21.480823 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:21.480847 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:21.480875 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:21.480896 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:21.480922 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:21.480951 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:21.480965 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:21.480996 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:21.481012 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:21.483966 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:21.484022 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0513 07:32:21.533754 15421 new_cluster.go:1373] Cloud Provider ID: "aws" I0513 07:32:21.533953 15421 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0513 07:32:21.533963 15421 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0513 07:32:21.533969 15421 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0513 07:32:21.534338 15421 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.06s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I0513 07:32:21.540320 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:21.540447 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:21.540471 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:21.540532 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:21.540564 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:21.540592 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:21.540617 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:21.540630 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:21.540651 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:21.540666 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:21.547504 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.01s) === RUN TestMinimal I0513 07:32:21.550221 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:21.550414 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:21.550446 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:21.550482 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:21.550509 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:21.550543 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:21.550571 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:21.550590 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:21.550616 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:21.550637 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:21.568648 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0513 07:32:21.571002 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:21.571067 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0513 07:32:26.953013 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:30.130114 15421 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0513 07:32:30.131709 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:32:30.131739 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:32:30.131855 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:32:30.133477 15421 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0513 07:32:30.137131 15421 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0513 07:32:30.137721 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:30.137866 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:30.138140 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:30.138326 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:30.138412 15421 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0513 07:32:30.138723 15421 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0513 07:32:30.139035 15421 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0513 07:32:30.144573 15421 target.go:111] Terraform output is in /tmp/test2577231335/out --- PASS: TestMinimal (8.60s) === RUN TestMinimal_v1_23 I0513 07:32:30.149003 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:30.149183 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:30.149218 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:30.149258 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:30.149287 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:30.149323 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:30.149352 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:30.149371 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:30.149398 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:30.149419 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:30.173120 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0513 07:32:30.175766 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:30.175833 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:32.231241 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:32.366545 15421 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0513 07:32:32.367410 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:32:32.367433 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:32:32.367500 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:32:32.368805 15421 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0513 07:32:32.373431 15421 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0513 07:32:32.373745 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:32.373991 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:32.374217 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:32.374607 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:32.374711 15421 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0513 07:32:32.374938 15421 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0513 07:32:32.375157 15421 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0513 07:32:32.380780 15421 target.go:111] Terraform output is in /tmp/test81585510/out --- PASS: TestMinimal_v1_23 (2.24s) === RUN TestMinimal_v1_24 I0513 07:32:32.385231 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:32.385410 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:32.385443 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:32.385487 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:32.385518 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:32.385553 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:32.385584 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:32.385603 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:32.385631 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:32.385649 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:32.409614 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:32:32.412314 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:32.412389 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:34.422855 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:34.562949 15421 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0513 07:32:34.566042 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:32:34.566077 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:32:34.566157 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:32:34.566341 15421 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0513 07:32:34.570005 15421 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0513 07:32:34.572203 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:34.572755 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:34.573396 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:34.573497 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:34.573661 15421 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0513 07:32:34.575324 15421 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0513 07:32:34.575670 15421 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0513 07:32:34.581639 15421 target.go:111] Terraform output is in /tmp/test3332134640/out --- PASS: TestMinimal_v1_24 (2.20s) === RUN TestMinimal_v1_25 I0513 07:32:34.586181 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:34.586360 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:34.586394 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:34.586432 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:34.586468 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:34.586506 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:34.586539 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:34.586558 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:34.586585 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:34.586606 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:34.606745 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0513 07:32:34.609529 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:34.609597 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:36.597040 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:36.735172 15421 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0513 07:32:36.742152 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:32:36.742187 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:32:36.742269 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:32:36.743631 15421 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0513 07:32:36.748305 15421 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0513 07:32:36.748697 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:36.748946 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:36.749113 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:36.749600 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:36.749704 15421 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0513 07:32:36.749915 15421 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0513 07:32:36.750100 15421 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0513 07:32:36.755636 15421 target.go:111] Terraform output is in /tmp/test3466736188/out --- PASS: TestMinimal_v1_25 (2.17s) === RUN TestMinimal_v1_26 I0513 07:32:36.760147 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:36.760325 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:36.760359 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:36.760398 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:36.760428 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:36.760463 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:36.760494 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:36.760513 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:36.760539 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:36.760560 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:36.780728 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0513 07:32:36.783266 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:36.783326 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:38.869942 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:38.983377 15421 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0513 07:32:38.983783 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:32:38.983818 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:32:38.985147 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:32:38.989252 15421 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0513 07:32:38.991667 15421 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0513 07:32:38.991931 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:38.992112 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:38.992331 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:38.992509 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:38.992599 15421 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0513 07:32:38.992781 15421 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0513 07:32:38.992936 15421 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0513 07:32:38.998144 15421 target.go:111] Terraform output is in /tmp/test3939606675/out --- PASS: TestMinimal_v1_26 (2.24s) === RUN TestMinimal_v1_27 I0513 07:32:39.002631 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:39.002825 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:39.002860 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:39.002900 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:39.002935 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:39.002971 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:39.003001 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:39.003026 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:39.003053 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:39.003072 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:39.023760 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0513 07:32:39.027850 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:39.027959 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:41.814291 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:41.934930 15421 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0513 07:32:41.935619 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:32:41.935645 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:32:41.935704 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:32:41.943138 15421 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0513 07:32:41.946977 15421 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0513 07:32:41.947474 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:41.947652 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:41.947758 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:41.948112 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:41.948183 15421 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0513 07:32:41.948345 15421 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0513 07:32:41.948494 15421 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0513 07:32:41.952482 15421 target.go:111] Terraform output is in /tmp/test4224776500/out --- PASS: TestMinimal_v1_27 (2.95s) === RUN TestMinimal_NoneDNS I0513 07:32:41.954618 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:41.954725 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:41.954749 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:41.954772 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:41.954789 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:41.954810 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:41.954827 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:41.954836 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:41.954850 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:41.954862 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0513 07:32:41.966400 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:41.966459 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:43.394648 15421 executor.go:111] Tasks: 0 done / 110 total; 43 can run I0513 07:32:43.396757 15421 executor.go:111] Tasks: 43 done / 110 total; 24 can run I0513 07:32:43.398406 15421 executor.go:111] Tasks: 67 done / 110 total; 29 can run I0513 07:32:43.398953 15421 executor.go:111] Tasks: 96 done / 110 total; 2 can run I0513 07:32:43.398991 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:32:43.399040 15421 loadbalancers.go:35] PageSize not implemented I0513 07:32:43.399121 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:32:43.399169 15421 loadbalancers.go:35] PageSize not implemented I0513 07:32:43.401096 15421 executor.go:111] Tasks: 98 done / 110 total; 4 can run I0513 07:32:43.401214 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:43.401365 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:43.401550 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:43.401614 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:43.401673 15421 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0513 07:32:43.401836 15421 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0513 07:32:43.402006 15421 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0513 07:32:43.406583 15421 target.go:111] Terraform output is in /tmp/test3533074789/out --- PASS: TestMinimal_NoneDNS (1.46s) === RUN TestHetzner I0513 07:32:43.409861 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:32:45.400662 15421 executor.go:111] Tasks: 0 done / 46 total; 37 can run I0513 07:32:45.403868 15421 executor.go:111] Tasks: 37 done / 46 total; 3 can run I0513 07:32:45.404143 15421 executor.go:111] Tasks: 40 done / 46 total; 2 can run I0513 07:32:45.411010 15421 executor.go:111] Tasks: 42 done / 46 total; 4 can run I0513 07:32:45.411916 15421 executor.go:111] Tasks: 46 done / 46 total; 0 can run I0513 07:32:45.414614 15421 target.go:111] Terraform output is in /tmp/test1309699523/out --- PASS: TestHetzner (2.01s) === RUN TestNvidia I0513 07:32:45.417524 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:45.417708 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:45.417742 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:45.417787 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:45.417816 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:45.417851 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:45.417881 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:45.417900 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:45.417936 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:45.417954 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:45.436609 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:32:45.439256 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:45.439319 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:47.187397 15421 zones.go:93] ListHostedZonesPages { } I0513 07:32:47.415650 15421 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0513 07:32:47.418069 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:32:47.418094 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:32:47.418149 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:32:47.418951 15421 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0513 07:32:47.427649 15421 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0513 07:32:47.428104 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:47.428638 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:47.428923 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:47.429032 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:47.429129 15421 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0513 07:32:47.429363 15421 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0513 07:32:47.429585 15421 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0513 07:32:47.435576 15421 target.go:111] Terraform output is in /tmp/test1305577048/out --- PASS: TestNvidia (2.02s) === RUN TestMinimalGossip I0513 07:32:47.440331 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:47.440535 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:47.440574 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:47.440617 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:47.440647 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:47.440688 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:47.440721 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:47.440742 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:47.440774 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:47.440797 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:32:47.462746 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:47.462818 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:48.872692 15421 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0513 07:32:48.875780 15421 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0513 07:32:48.880215 15421 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0513 07:32:48.880445 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:48.880534 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:48.880692 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:48.880899 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:48.880987 15421 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0513 07:32:48.881176 15421 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0513 07:32:48.881345 15421 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0513 07:32:48.886710 15421 target.go:111] Terraform output is in /tmp/test3068675322/out --- PASS: TestMinimalGossip (1.45s) === RUN TestMinimalGossipIRSA I0513 07:32:48.891462 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:48.891652 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:48.891708 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:48.891744 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:48.891773 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:48.891808 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:48.891837 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:48.891858 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:48.891913 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:48.891935 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:32:48.919328 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:48.919466 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:50.428033 15421 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0513 07:32:50.432010 15421 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0513 07:32:50.437005 15421 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0513 07:32:50.437320 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:50.437509 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:50.437733 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:50.437874 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:32:50.437963 15421 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0513 07:32:50.438193 15421 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0513 07:32:50.438432 15421 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0513 07:32:50.444810 15421 target.go:111] Terraform output is in /tmp/test3081495067/out --- PASS: TestMinimalGossipIRSA (1.56s) === RUN TestMinimalGCE I0513 07:32:50.450415 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:50.451898 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:32:52.643028 15421 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0513 07:32:52.643125 15421 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0513 07:32:52.643235 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0513 07:32:52.643258 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0513 07:32:52.643278 15421 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0513 07:32:52.643336 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0513 07:32:52.644574 15421 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0513 07:32:52.647137 15421 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0513 07:32:52.650508 15421 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0513 07:32:52.651320 15421 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0513 07:32:52.651625 15421 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0513 07:32:52.655353 15421 target.go:111] Terraform output is in /tmp/test2043841000/out --- PASS: TestMinimalGCE (2.21s) === RUN TestMinimalGCEPrivate I0513 07:32:52.658762 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:52.660217 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:32:54.375012 15421 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0513 07:32:54.375071 15421 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0513 07:32:54.375149 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W0513 07:32:54.375163 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W0513 07:32:54.375177 15421 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W0513 07:32:54.375234 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0513 07:32:54.376067 15421 executor.go:111] Tasks: 0 done / 65 total; 41 can run I0513 07:32:54.384508 15421 executor.go:111] Tasks: 41 done / 65 total; 17 can run I0513 07:32:54.389319 15421 executor.go:111] Tasks: 58 done / 65 total; 5 can run I0513 07:32:54.390235 15421 executor.go:111] Tasks: 63 done / 65 total; 2 can run I0513 07:32:54.390459 15421 executor.go:111] Tasks: 65 done / 65 total; 0 can run I0513 07:32:54.394532 15421 target.go:111] Terraform output is in /tmp/test3439712771/out --- PASS: TestMinimalGCEPrivate (1.74s) === RUN TestMinimalGCEInternalLoadBalancer I0513 07:32:54.397955 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:54.399508 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:32:56.139902 15421 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0513 07:32:56.139955 15421 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0513 07:32:56.140042 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W0513 07:32:56.140061 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W0513 07:32:56.140075 15421 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W0513 07:32:56.140119 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0513 07:32:56.140152 15421 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0513 07:32:56.141082 15421 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0513 07:32:56.149835 15421 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0513 07:32:56.150316 15421 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0513 07:32:56.150620 15421 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0513 07:32:56.155008 15421 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0513 07:32:56.155915 15421 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0513 07:32:56.156132 15421 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0513 07:32:56.156357 15421 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0513 07:32:56.156558 15421 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0513 07:32:56.160762 15421 target.go:111] Terraform output is in /tmp/test2141721971/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.77s) === RUN TestMinimalGCEPublicLoadBalancer I0513 07:32:56.164304 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:56.165878 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:32:57.889503 15421 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0513 07:32:57.889562 15421 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0513 07:32:57.889672 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W0513 07:32:57.889691 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W0513 07:32:57.889709 15421 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W0513 07:32:57.889764 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0513 07:32:57.890913 15421 executor.go:111] Tasks: 0 done / 71 total; 43 can run I0513 07:32:57.895303 15421 executor.go:111] Tasks: 43 done / 71 total; 19 can run I0513 07:32:57.899728 15421 executor.go:111] Tasks: 62 done / 71 total; 7 can run I0513 07:32:57.900639 15421 executor.go:111] Tasks: 69 done / 71 total; 2 can run I0513 07:32:57.900811 15421 executor.go:111] Tasks: 71 done / 71 total; 0 can run I0513 07:32:57.908251 15421 target.go:111] Terraform output is in /tmp/test1508905604/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.75s) === RUN TestMinimalGCELongClusterName I0513 07:32:57.912241 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:57.914029 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:32:59.642626 15421 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0513 07:32:59.642714 15421 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0513 07:32:59.642815 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0513 07:32:59.642835 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0513 07:32:59.642853 15421 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0513 07:32:59.642908 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0513 07:32:59.643875 15421 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0513 07:32:59.646933 15421 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0513 07:32:59.651416 15421 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0513 07:32:59.652318 15421 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0513 07:32:59.652488 15421 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0513 07:32:59.660771 15421 target.go:111] Terraform output is in /tmp/test647091566/out --- PASS: TestMinimalGCELongClusterName (1.75s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I0513 07:32:59.664449 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:59.666087 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:33:01.399544 15421 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0513 07:33:01.399618 15421 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0513 07:33:01.399760 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0513 07:33:01.399786 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0513 07:33:01.399808 15421 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0513 07:33:01.399869 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0513 07:33:01.399913 15421 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0513 07:33:01.401191 15421 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0513 07:33:01.403874 15421 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0513 07:33:01.404358 15421 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0513 07:33:01.404551 15421 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0513 07:33:01.408990 15421 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0513 07:33:01.409750 15421 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0513 07:33:01.409915 15421 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0513 07:33:01.410054 15421 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0513 07:33:01.410186 15421 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0513 07:33:01.414432 15421 target.go:111] Terraform output is in /tmp/test2674561468/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.75s) === RUN TestMinimalGCEDNSNone I0513 07:33:01.418022 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:01.419642 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:33:03.167385 15421 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0513 07:33:03.167447 15421 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0513 07:33:03.167558 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0513 07:33:03.167583 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0513 07:33:03.167602 15421 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0513 07:33:03.167657 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0513 07:33:03.167692 15421 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0513 07:33:03.168871 15421 executor.go:111] Tasks: 0 done / 72 total; 41 can run I0513 07:33:03.172352 15421 executor.go:111] Tasks: 41 done / 72 total; 18 can run I0513 07:33:03.173004 15421 executor.go:111] Tasks: 59 done / 72 total; 2 can run I0513 07:33:03.173158 15421 executor.go:111] Tasks: 61 done / 72 total; 2 can run I0513 07:33:03.177674 15421 executor.go:111] Tasks: 63 done / 72 total; 4 can run I0513 07:33:03.178450 15421 executor.go:111] Tasks: 67 done / 72 total; 2 can run I0513 07:33:03.178622 15421 executor.go:111] Tasks: 69 done / 72 total; 1 can run I0513 07:33:03.178759 15421 executor.go:111] Tasks: 70 done / 72 total; 2 can run I0513 07:33:03.178926 15421 executor.go:111] Tasks: 72 done / 72 total; 0 can run I0513 07:33:03.182800 15421 target.go:111] Terraform output is in /tmp/test2025553475/out --- PASS: TestMinimalGCEDNSNone (1.77s) === RUN TestMinimalScaleway I0513 07:33:03.186186 15421 featureflag.go:164] FeatureFlag "Scaleway"=true I0513 07:33:03.186204 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:33:05.073353 15421 executor.go:111] Tasks: 0 done / 49 total; 37 can run I0513 07:33:05.076239 15421 executor.go:111] Tasks: 37 done / 49 total; 6 can run I0513 07:33:05.084666 15421 executor.go:111] Tasks: 43 done / 49 total; 6 can run I0513 07:33:05.085813 15421 executor.go:111] Tasks: 49 done / 49 total; 0 can run I0513 07:33:05.088715 15421 target.go:111] Terraform output is in /tmp/test4183474334/out I0513 07:33:05.092179 15421 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (1.91s) === RUN TestHA I0513 07:33:05.092309 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:05.092521 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:05.092568 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:05.092621 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:05.092660 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:05.092707 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:05.092748 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:05.092777 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:05.092806 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:05.092835 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:05.118384 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:05.121328 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:05.121410 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:05.121459 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:05.121518 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:06.440938 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:06.590080 15421 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0513 07:33:06.595392 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:06.596588 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:06.596711 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:06.597966 15421 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0513 07:33:06.605824 15421 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0513 07:33:06.606336 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:06.606606 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:06.606769 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:06.606846 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:06.607018 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:06.607158 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:06.607213 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:06.607394 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:06.607499 15421 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0513 07:33:06.607777 15421 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0513 07:33:06.608157 15421 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0513 07:33:06.615692 15421 target.go:111] Terraform output is in /tmp/test1930453571/out --- PASS: TestHA (1.53s) === RUN TestHighAvailabilityGCE I0513 07:33:06.621339 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:06.622968 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:33:08.362808 15421 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0513 07:33:08.362892 15421 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0513 07:33:08.363005 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W0513 07:33:08.363024 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W0513 07:33:08.363043 15421 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W0513 07:33:08.363104 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0513 07:33:08.363166 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0513 07:33:08.363220 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0513 07:33:08.364609 15421 executor.go:111] Tasks: 0 done / 82 total; 49 can run I0513 07:33:08.367360 15421 executor.go:111] Tasks: 49 done / 82 total; 19 can run I0513 07:33:08.372078 15421 executor.go:111] Tasks: 68 done / 82 total; 8 can run I0513 07:33:08.372867 15421 executor.go:111] Tasks: 76 done / 82 total; 6 can run I0513 07:33:08.373151 15421 executor.go:111] Tasks: 82 done / 82 total; 0 can run I0513 07:33:08.378186 15421 target.go:111] Terraform output is in /tmp/test3916763091/out --- PASS: TestHighAvailabilityGCE (1.76s) === RUN TestComplex I0513 07:33:08.382780 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:08.383007 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:08.383046 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:08.383131 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:08.383168 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:08.383208 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:08.383244 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:08.383264 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:08.383293 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:08.383317 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:08.414438 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:33:08.418069 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:08.418170 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:10.392705 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:10.545997 15421 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0513 07:33:10.546485 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:10.546539 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:10.546657 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:10.550339 15421 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0513 07:33:10.557538 15421 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0513 07:33:10.558878 15421 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0513 07:33:10.559144 15421 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0513 07:33:10.559208 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:10.559274 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:10.559396 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:10.559462 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:10.563866 15421 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0513 07:33:10.564020 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:10.564224 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:10.564467 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:10.565292 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:10.565416 15421 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0513 07:33:10.565714 15421 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0513 07:33:10.565999 15421 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0513 07:33:10.573345 15421 target.go:111] Terraform output is in /tmp/test3009051665/out I0513 07:33:10.578178 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:10.578363 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:10.578403 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:10.578444 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:10.578475 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:10.578514 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:10.578568 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:10.578591 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:10.578619 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:10.578641 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:10.604871 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:33:10.608305 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:10.608378 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:11.959384 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:12.119017 15421 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0513 07:33:12.122079 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:12.122113 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:12.122191 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:12.123122 15421 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0513 07:33:12.125711 15421 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0513 07:33:12.126413 15421 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0513 07:33:12.126623 15421 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0513 07:33:12.126680 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:12.126740 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:12.126834 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:12.126899 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:12.131267 15421 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0513 07:33:12.131405 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:12.131582 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:12.132032 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:12.132101 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:12.132213 15421 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0513 07:33:12.132454 15421 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0513 07:33:12.132745 15421 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0513 07:33:12.139652 15421 target.go:111] Terraform output is in /tmp/test380099362/out --- PASS: TestComplex (3.76s) === RUN TestCompress I0513 07:33:12.144749 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:12.144946 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:12.144982 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:12.145020 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:12.145051 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:12.145089 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:12.145119 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:12.145139 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:12.145166 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:12.145187 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:12.166568 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:12.171123 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:12.171202 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:13.463594 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:13.604420 15421 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0513 07:33:13.605694 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:13.605726 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:13.605806 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:13.607319 15421 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0513 07:33:13.611790 15421 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0513 07:33:13.612202 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:13.612432 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:13.613707 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:13.613993 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:13.614096 15421 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0513 07:33:13.614325 15421 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0513 07:33:13.614590 15421 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0513 07:33:13.623756 15421 target.go:111] Terraform output is in /tmp/test800650780/out --- PASS: TestCompress (1.48s) === RUN TestExternalPolicies I0513 07:33:13.629113 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:13.629460 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:13.629530 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:13.629574 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:13.629609 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:13.629646 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:13.629681 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:13.629701 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:13.629729 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:13.629751 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:13.651988 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:13.654825 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:13.654893 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:14.950442 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:15.094339 15421 executor.go:111] Tasks: 0 done / 115 total; 47 can run I0513 07:33:15.095409 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:15.095443 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:15.095524 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:15.096859 15421 executor.go:111] Tasks: 47 done / 115 total; 22 can run I0513 07:33:15.099361 15421 executor.go:111] Tasks: 69 done / 115 total; 30 can run I0513 07:33:15.099918 15421 executor.go:111] Tasks: 99 done / 115 total; 4 can run W0513 07:33:15.100018 15421 api.go:53] PageSize not implemented W0513 07:33:15.100131 15421 api.go:53] PageSize not implemented I0513 07:33:15.104517 15421 executor.go:111] Tasks: 103 done / 115 total; 4 can run I0513 07:33:15.104671 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:15.104797 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:15.105172 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:15.105259 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:15.105347 15421 executor.go:111] Tasks: 107 done / 115 total; 2 can run I0513 07:33:15.105582 15421 executor.go:111] Tasks: 109 done / 115 total; 6 can run I0513 07:33:15.105768 15421 executor.go:111] Tasks: 115 done / 115 total; 0 can run I0513 07:33:15.117017 15421 target.go:111] Terraform output is in /tmp/test229830663/out --- PASS: TestExternalPolicies (1.49s) === RUN TestMinimalIPv6 I0513 07:33:15.121683 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:15.121899 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:15.121940 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:15.121981 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:15.122016 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:15.122055 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:15.122088 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:15.122110 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:15.122141 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:15.122163 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:15.146241 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:33:15.149479 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:15.149552 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:16.462914 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:16.606435 15421 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0513 07:33:16.606962 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:16.607005 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:16.607125 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:16.609079 15421 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0513 07:33:16.611613 15421 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0513 07:33:16.612303 15421 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0513 07:33:16.613698 15421 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0513 07:33:16.613912 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:16.614147 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:16.614261 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:16.614471 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:16.621474 15421 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0513 07:33:16.621633 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:16.621816 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:16.622036 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:16.622494 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:16.622587 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:33:16.622878 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:33:16.623191 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0513 07:33:16.630123 15421 target.go:111] Terraform output is in /tmp/test1538359410/out --- PASS: TestMinimalIPv6 (1.51s) === RUN TestMinimalIPv6Calico I0513 07:33:16.634914 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:16.635130 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:16.635179 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:16.635273 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:16.635327 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:16.635392 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:16.635445 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:16.635486 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:16.635540 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:16.635575 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:16.658783 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:33:16.661836 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:16.661954 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:17.974289 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:18.345400 15421 executor.go:111] Tasks: 0 done / 138 total; 47 can run I0513 07:33:18.345945 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:18.345983 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:18.346066 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:18.348071 15421 executor.go:111] Tasks: 47 done / 138 total; 25 can run I0513 07:33:18.350776 15421 executor.go:111] Tasks: 72 done / 138 total; 37 can run I0513 07:33:18.351418 15421 executor.go:111] Tasks: 109 done / 138 total; 9 can run I0513 07:33:18.351691 15421 executor.go:111] Tasks: 118 done / 138 total; 8 can run I0513 07:33:18.351785 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:18.351859 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:18.351967 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:18.352026 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:18.356313 15421 executor.go:111] Tasks: 126 done / 138 total; 4 can run I0513 07:33:18.356460 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:18.356656 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:18.356824 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:18.357343 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:18.357440 15421 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0513 07:33:18.357748 15421 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0513 07:33:18.358055 15421 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0513 07:33:18.365256 15421 target.go:111] Terraform output is in /tmp/test2820274546/out --- PASS: TestMinimalIPv6Calico (1.74s) === RUN TestMinimalIPv6Cilium I0513 07:33:18.371437 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:18.371639 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:18.371679 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:18.371720 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:18.371753 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:18.371793 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:18.371835 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:18.371857 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:18.371907 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:18.371936 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:18.395484 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:33:18.399968 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:18.400117 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:19.711551 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:19.889005 15421 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0513 07:33:19.889335 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:19.889354 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:19.889419 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:19.895667 15421 executor.go:111] Tasks: 47 done / 137 total; 25 can run I0513 07:33:19.899255 15421 executor.go:111] Tasks: 72 done / 137 total; 36 can run I0513 07:33:19.899917 15421 executor.go:111] Tasks: 108 done / 137 total; 9 can run I0513 07:33:19.900183 15421 executor.go:111] Tasks: 117 done / 137 total; 8 can run I0513 07:33:19.900311 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:19.900386 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:19.900507 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:19.900586 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:19.905102 15421 executor.go:111] Tasks: 125 done / 137 total; 4 can run I0513 07:33:19.905259 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:19.905455 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:19.905646 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:19.906094 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:19.906186 15421 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0513 07:33:19.906405 15421 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0513 07:33:19.906644 15421 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0513 07:33:19.913459 15421 target.go:111] Terraform output is in /tmp/test4274615750/out --- PASS: TestMinimalIPv6Cilium (1.55s) === RUN TestMinimalIPv6NoSubnetPrefix I0513 07:33:19.918304 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:19.918496 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:19.918533 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:19.918599 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:19.918631 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:19.918667 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:19.918705 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:19.918726 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:19.918755 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:19.918778 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:19.942028 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:33:19.945447 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:19.945515 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:21.275830 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:21.423997 15421 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0513 07:33:21.429012 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:21.429132 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:21.429274 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:21.432188 15421 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0513 07:33:21.434973 15421 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0513 07:33:21.435743 15421 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0513 07:33:21.436014 15421 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0513 07:33:21.436108 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:21.436189 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:21.436293 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:33:21.436369 15421 loadbalancers.go:35] PageSize not implemented I0513 07:33:21.440743 15421 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0513 07:33:21.440952 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:21.441152 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:21.441522 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:21.441601 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:21.441702 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:33:21.441962 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:33:21.442224 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0513 07:33:21.448757 15421 target.go:111] Terraform output is in /tmp/test2713642030/out --- PASS: TestMinimalIPv6NoSubnetPrefix (1.54s) === RUN TestMinimalWarmPool I0513 07:33:21.453616 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:21.453812 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:21.453850 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:21.453888 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:21.453923 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:21.453962 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:21.453995 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:21.454016 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:21.454043 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:21.454065 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:21.473847 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:21.476787 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:21.476852 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:22.776864 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:22.961479 15421 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0513 07:33:22.962079 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:22.962121 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:22.962219 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:22.964620 15421 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0513 07:33:22.969195 15421 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0513 07:33:22.969360 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:22.969533 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:22.969901 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:22.969982 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:22.970077 15421 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0513 07:33:22.970294 15421 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0513 07:33:22.970575 15421 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0513 07:33:22.976363 15421 target.go:111] Terraform output is in /tmp/test1325870410/out --- PASS: TestMinimalWarmPool (1.53s) === RUN TestMinimalEtcd I0513 07:33:22.983894 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:22.985302 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:22.985345 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:22.985392 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:22.985430 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:22.985469 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:22.985510 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:22.985531 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:22.985560 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:22.985583 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:23.006716 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:23.009505 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:23.009572 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:24.313055 15421 zones.go:93] ListHostedZonesPages { } W0513 07:33:24.445618 15421 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W0513 07:33:24.445666 15421 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W0513 07:33:24.448032 15421 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I0513 07:33:24.457945 15421 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0513 07:33:24.458417 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:24.458449 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:24.458557 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:24.460880 15421 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0513 07:33:24.465003 15421 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0513 07:33:24.465279 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:24.465504 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:24.465693 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:24.466172 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:24.467325 15421 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0513 07:33:24.467904 15421 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0513 07:33:24.468574 15421 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0513 07:33:24.477478 15421 target.go:111] Terraform output is in /tmp/test2040807453/out --- PASS: TestMinimalEtcd (1.50s) === RUN TestMinimalGp3 I0513 07:33:24.482061 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:24.482254 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:24.482292 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:24.482335 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:24.482368 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:24.482406 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:24.482441 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:24.482463 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:24.482491 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:24.482514 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:24.502007 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:24.504519 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:24.504584 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:25.862063 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:26.003832 15421 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0513 07:33:26.006585 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:26.006618 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:26.006694 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:26.007896 15421 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0513 07:33:26.017832 15421 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0513 07:33:26.018260 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:26.018791 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:26.019007 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:26.019213 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:26.019319 15421 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0513 07:33:26.019572 15421 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0513 07:33:26.019764 15421 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0513 07:33:26.025865 15421 target.go:111] Terraform output is in /tmp/test1937664466/out --- PASS: TestMinimalGp3 (1.55s) === RUN TestMinimalLongClusterName I0513 07:33:26.030522 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:26.030719 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:26.030763 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:26.030804 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:26.030835 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:26.030876 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:26.030913 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:26.030934 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:26.030963 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:26.030986 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:26.049697 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:26.052413 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:26.052474 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0513 07:33:27.350353 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:27.494938 15421 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0513 07:33:27.495892 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:27.495921 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:27.496006 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:27.497566 15421 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0513 07:33:27.502413 15421 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0513 07:33:27.502607 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:27.503008 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:27.503075 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:27.503586 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:27.503667 15421 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0513 07:33:27.503948 15421 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0513 07:33:27.504228 15421 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0513 07:33:27.510011 15421 target.go:111] Terraform output is in /tmp/test2901558232/out --- PASS: TestMinimalLongClusterName (1.48s) === RUN TestExistingSG I0513 07:33:27.514791 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:27.514993 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:27.515031 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:27.515072 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:27.515106 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:27.515142 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:27.515175 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:27.515195 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:27.515247 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:27.515270 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:27.541431 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:27.544145 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:27.544208 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:27.544245 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:27.544277 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:28.889586 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:29.135020 15421 executor.go:111] Tasks: 0 done / 163 total; 53 can run I0513 07:33:29.137181 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:29.137220 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:29.137335 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:29.138861 15421 executor.go:111] Tasks: 53 done / 163 total; 26 can run I0513 07:33:29.141371 15421 executor.go:111] Tasks: 79 done / 163 total; 54 can run I0513 07:33:29.143061 15421 executor.go:111] Tasks: 133 done / 163 total; 6 can run W0513 07:33:29.143154 15421 api.go:53] PageSize not implemented W0513 07:33:29.143266 15421 api.go:53] PageSize not implemented W0513 07:33:29.143380 15421 api.go:53] PageSize not implemented W0513 07:33:29.143448 15421 api.go:53] PageSize not implemented I0513 07:33:29.152765 15421 executor.go:111] Tasks: 139 done / 163 total; 8 can run I0513 07:33:29.152932 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:29.153153 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:29.153334 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:29.153416 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:29.153543 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:29.153616 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:29.153936 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:29.154002 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:29.154072 15421 executor.go:111] Tasks: 147 done / 163 total; 4 can run I0513 07:33:29.154366 15421 executor.go:111] Tasks: 151 done / 163 total; 12 can run I0513 07:33:29.154697 15421 executor.go:111] Tasks: 163 done / 163 total; 0 can run I0513 07:33:29.163495 15421 target.go:111] Terraform output is in /tmp/test1698974247/out --- PASS: TestExistingSG (1.65s) === RUN TestBastionAdditionalUserData I0513 07:33:29.169461 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:29.169672 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:29.169712 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:29.169764 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:29.169798 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:29.169837 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:29.169873 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:29.169893 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:29.169924 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:29.169947 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:29.192669 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:29.195501 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:29.195565 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:29.195606 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:30.521770 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:30.671221 15421 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0513 07:33:30.672231 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:30.672263 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:30.672349 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:30.674410 15421 executor.go:111] Tasks: 47 done / 137 total; 30 can run I0513 07:33:30.677729 15421 executor.go:111] Tasks: 77 done / 137 total; 35 can run I0513 07:33:30.682556 15421 executor.go:111] Tasks: 112 done / 137 total; 6 can run W0513 07:33:30.683475 15421 api.go:53] PageSize not implemented W0513 07:33:30.683533 15421 api.go:53] PageSize not implemented W0513 07:33:30.683682 15421 api.go:53] PageSize not implemented I0513 07:33:30.687863 15421 executor.go:111] Tasks: 118 done / 137 total; 7 can run I0513 07:33:30.688086 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:30.688232 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:30.688501 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:30.688719 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:30.688875 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:30.688972 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:30.689088 15421 executor.go:111] Tasks: 125 done / 137 total; 3 can run I0513 07:33:30.689381 15421 executor.go:111] Tasks: 128 done / 137 total; 9 can run I0513 07:33:30.689638 15421 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0513 07:33:30.697377 15421 target.go:111] Terraform output is in /tmp/test2781620662/out --- PASS: TestBastionAdditionalUserData (1.53s) === RUN TestPrivateFlannel I0513 07:33:30.702567 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:30.702775 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:30.702814 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:30.702853 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:30.702884 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:30.702923 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:30.702959 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:30.702979 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:30.703007 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:30.703029 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:30.725291 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:33:30.728150 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:30.728212 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:30.728254 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:32.035000 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:32.208798 15421 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0513 07:33:32.210835 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:32.210864 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:32.210940 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:32.212397 15421 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0513 07:33:32.214919 15421 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0513 07:33:32.215659 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:32.215795 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:32.216021 15421 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0513 07:33:32.216109 15421 api.go:53] PageSize not implemented W0513 07:33:32.216211 15421 api.go:53] PageSize not implemented I0513 07:33:32.221435 15421 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0513 07:33:32.222002 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:32.222348 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:32.223095 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:32.223583 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:32.223841 15421 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0513 07:33:32.224780 15421 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0513 07:33:32.226302 15421 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0513 07:33:32.233403 15421 target.go:111] Terraform output is in /tmp/test2671516418/out --- PASS: TestPrivateFlannel (1.54s) === RUN TestPrivateCalico I0513 07:33:32.238522 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:32.238748 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:32.238788 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:32.238831 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:32.238862 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:32.238901 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:32.238934 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:32.238954 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:32.238985 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:32.239007 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:32.261113 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:33:32.263893 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:32.263950 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:32.263988 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:33.548101 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:33.914003 15421 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0513 07:33:33.914778 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:33.914809 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:33.914898 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:33.917477 15421 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0513 07:33:33.924005 15421 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0513 07:33:33.924951 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:33.925091 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:33.925261 15421 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0513 07:33:33.925347 15421 api.go:53] PageSize not implemented W0513 07:33:33.925402 15421 api.go:53] PageSize not implemented I0513 07:33:33.929482 15421 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0513 07:33:33.929633 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:33.929824 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:33.930182 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:33.930249 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:33.930314 15421 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0513 07:33:33.930524 15421 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0513 07:33:33.930929 15421 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0513 07:33:33.939106 15421 target.go:111] Terraform output is in /tmp/test648825360/out --- PASS: TestPrivateCalico (1.71s) === RUN TestPrivateCilium I0513 07:33:33.944904 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:33.945105 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:33.945144 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:33.945184 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:33.945233 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:33.945273 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:33.945308 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:33.945329 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:33.945358 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:33.945385 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:33.967781 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:33.970744 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:33.970804 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:33.970840 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:35.275452 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:35.452119 15421 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0513 07:33:35.453373 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:35.453407 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:35.453496 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:35.455384 15421 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0513 07:33:35.458134 15421 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0513 07:33:35.458422 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:35.458628 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:35.458864 15421 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0513 07:33:35.458944 15421 api.go:53] PageSize not implemented W0513 07:33:35.458983 15421 api.go:53] PageSize not implemented I0513 07:33:35.463579 15421 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0513 07:33:35.463849 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:35.463952 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:35.464348 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:35.464426 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:35.464516 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:33:35.464763 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:33:35.465019 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0513 07:33:35.477324 15421 target.go:111] Terraform output is in /tmp/test1491742424/out --- PASS: TestPrivateCilium (1.54s) === RUN TestPrivateCilium2 I0513 07:33:35.482570 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:35.482954 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:35.483037 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:35.483106 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:35.483173 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:35.483233 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:35.483405 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:35.483445 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:35.483494 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:35.483538 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:35.505958 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:33:35.509088 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:35.509155 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:35.509198 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:36.844642 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:37.388991 15421 executor.go:111] Tasks: 0 done / 138 total; 50 can run I0513 07:33:37.391434 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:37.391474 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:37.391558 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:37.393807 15421 executor.go:111] Tasks: 50 done / 138 total; 30 can run I0513 07:33:37.396564 15421 executor.go:111] Tasks: 80 done / 138 total; 36 can run I0513 07:33:37.397094 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:37.397237 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:37.397332 15421 executor.go:111] Tasks: 116 done / 138 total; 6 can run W0513 07:33:37.397419 15421 api.go:53] PageSize not implemented W0513 07:33:37.397469 15421 api.go:53] PageSize not implemented I0513 07:33:37.401669 15421 executor.go:111] Tasks: 122 done / 138 total; 8 can run I0513 07:33:37.402030 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:37.402283 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:37.402837 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:37.402916 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:37.403041 15421 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0513 07:33:37.403391 15421 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0513 07:33:37.403670 15421 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0513 07:33:37.416602 15421 target.go:111] Terraform output is in /tmp/test86720829/out --- PASS: TestPrivateCilium2 (1.94s) === RUN TestPrivateCiliumAdvanced I0513 07:33:37.424605 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:37.424797 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:37.424834 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:37.424873 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:37.424903 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:37.424939 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:37.424971 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:37.424988 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:37.425013 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:37.425034 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:37.448006 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:37.450527 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:37.450582 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:37.450615 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:38.786656 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:38.965506 15421 executor.go:111] Tasks: 0 done / 142 total; 54 can run I0513 07:33:38.966224 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:38.966259 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:38.966345 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:38.968404 15421 executor.go:111] Tasks: 54 done / 142 total; 30 can run I0513 07:33:38.971231 15421 executor.go:111] Tasks: 84 done / 142 total; 36 can run I0513 07:33:38.971582 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:38.971789 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:38.971940 15421 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0513 07:33:38.972046 15421 api.go:53] PageSize not implemented W0513 07:33:38.972164 15421 api.go:53] PageSize not implemented I0513 07:33:38.977152 15421 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0513 07:33:38.977308 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:38.977547 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:38.977667 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:38.978212 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:38.978306 15421 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0513 07:33:38.978589 15421 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0513 07:33:38.978849 15421 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0513 07:33:38.986114 15421 target.go:111] Terraform output is in /tmp/test3692066464/out --- PASS: TestPrivateCiliumAdvanced (1.57s) === RUN TestPrivateCiliumENI I0513 07:33:38.991383 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:38.991586 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:38.991624 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:38.991665 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:38.991702 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:38.991742 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:38.991776 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:38.991797 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:38.991825 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:38.991846 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:39.019898 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:39.022788 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:39.022855 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:39.022894 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:40.387460 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:40.563510 15421 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0513 07:33:40.564905 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:40.564949 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:40.565066 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:40.566358 15421 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0513 07:33:40.569144 15421 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0513 07:33:40.569487 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:40.569626 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:40.569823 15421 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0513 07:33:40.569921 15421 api.go:53] PageSize not implemented W0513 07:33:40.570043 15421 api.go:53] PageSize not implemented I0513 07:33:40.574275 15421 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0513 07:33:40.574512 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:40.574682 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:40.575103 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:40.575180 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:40.575275 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:33:40.575601 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:33:40.575866 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0513 07:33:40.583062 15421 target.go:111] Terraform output is in /tmp/test1063906541/out --- PASS: TestPrivateCiliumENI (1.60s) === RUN TestPrivateCanal I0513 07:33:40.588144 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:40.588337 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:40.588375 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:40.588416 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:40.588447 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:40.588488 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:40.588523 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:40.588561 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:40.588594 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:40.588618 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:40.610110 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:33:40.612933 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:40.612999 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:40.613041 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:42.004436 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:42.363545 15421 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0513 07:33:42.365059 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:42.365089 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:42.365176 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:42.367227 15421 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0513 07:33:42.369701 15421 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0513 07:33:42.370145 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:42.370312 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:42.370415 15421 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0513 07:33:42.370496 15421 api.go:53] PageSize not implemented W0513 07:33:42.370536 15421 api.go:53] PageSize not implemented I0513 07:33:42.374686 15421 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0513 07:33:42.374896 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:42.375030 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:42.375266 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:42.375670 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:42.376837 15421 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0513 07:33:42.377454 15421 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0513 07:33:42.378508 15421 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0513 07:33:42.388626 15421 target.go:111] Terraform output is in /tmp/test3035060366/out --- PASS: TestPrivateCanal (1.81s) === RUN TestPrivateKopeio I0513 07:33:42.395009 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:42.395227 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:42.395267 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:42.395311 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:42.395344 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:42.395386 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:42.395421 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:42.395442 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:42.395470 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:42.395495 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:42.418325 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:42.421208 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:42.421271 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:42.421316 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:43.746798 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:43.894790 15421 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0513 07:33:43.895277 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:43.895316 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:43.895404 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:43.903325 15421 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0513 07:33:43.906022 15421 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0513 07:33:43.906562 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:43.906734 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:43.906824 15421 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0513 07:33:43.906869 15421 api.go:53] PageSize not implemented W0513 07:33:43.907016 15421 api.go:53] PageSize not implemented I0513 07:33:43.911268 15421 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0513 07:33:43.911396 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:43.911533 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:43.911747 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:43.912130 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:43.912222 15421 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0513 07:33:43.912474 15421 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0513 07:33:43.912741 15421 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0513 07:33:43.919912 15421 target.go:111] Terraform output is in /tmp/test2807832735/out --- PASS: TestPrivateKopeio (1.53s) === RUN TestUnmanaged I0513 07:33:43.924884 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:43.925089 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:43.925130 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:43.925170 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:43.925223 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:43.925268 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:43.925303 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:43.925326 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:43.925355 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:43.925377 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:43.949556 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:43.955200 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:43.955327 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:43.955371 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:45.264262 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:45.405976 15421 executor.go:111] Tasks: 0 done / 126 total; 46 can run I0513 07:33:45.410952 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:45.411205 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:45.411389 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:45.414657 15421 executor.go:111] Tasks: 46 done / 126 total; 27 can run I0513 07:33:45.417480 15421 executor.go:111] Tasks: 73 done / 126 total; 33 can run I0513 07:33:45.417944 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:45.418080 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:45.418162 15421 executor.go:111] Tasks: 106 done / 126 total; 5 can run W0513 07:33:45.418219 15421 api.go:53] PageSize not implemented W0513 07:33:45.418353 15421 api.go:53] PageSize not implemented I0513 07:33:45.423204 15421 executor.go:111] Tasks: 111 done / 126 total; 7 can run I0513 07:33:45.423510 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:45.423727 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:45.424107 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:45.424295 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:45.424396 15421 executor.go:111] Tasks: 118 done / 126 total; 2 can run I0513 07:33:45.424748 15421 executor.go:111] Tasks: 120 done / 126 total; 6 can run I0513 07:33:45.425012 15421 executor.go:111] Tasks: 126 done / 126 total; 0 can run I0513 07:33:45.431732 15421 target.go:111] Terraform output is in /tmp/test2120009035/out --- PASS: TestUnmanaged (1.51s) === RUN TestPrivateSharedSubnet I0513 07:33:45.436743 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:45.436941 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:45.436978 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:45.437014 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:45.437044 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:45.437083 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:45.437116 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:45.437139 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:45.437169 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:45.437190 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:45.459749 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:45.462476 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:45.462539 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:45.462579 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:46.785444 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:46.939759 15421 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0513 07:33:46.942794 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:46.942838 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:46.942939 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:46.945656 15421 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0513 07:33:46.947085 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:33:46.949950 15421 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0513 07:33:46.950692 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:46.950834 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:46.951914 15421 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0513 07:33:46.951970 15421 api.go:53] PageSize not implemented W0513 07:33:46.952028 15421 api.go:53] PageSize not implemented I0513 07:33:46.956430 15421 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0513 07:33:46.956586 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:46.956779 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:46.956990 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:46.957352 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:46.957447 15421 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0513 07:33:46.957654 15421 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0513 07:33:46.957882 15421 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0513 07:33:46.964746 15421 target.go:111] Terraform output is in /tmp/test3373949975/out --- PASS: TestPrivateSharedSubnet (1.53s) === RUN TestPrivateSharedIP I0513 07:33:46.969708 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:46.969918 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:46.969959 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:46.970003 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:46.970036 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:46.970102 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:46.970136 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:46.970156 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:46.970184 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:46.970204 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:46.992157 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:46.995052 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:46.995136 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:46.995184 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:48.356531 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:48.504522 15421 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0513 07:33:48.507715 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:48.507741 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:48.508421 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:48.510599 15421 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0513 07:33:48.514293 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:33:48.516425 15421 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0513 07:33:48.516659 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:48.516831 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:48.517150 15421 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0513 07:33:48.517235 15421 api.go:53] PageSize not implemented W0513 07:33:48.517279 15421 api.go:53] PageSize not implemented I0513 07:33:48.522241 15421 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0513 07:33:48.522396 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:48.522571 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:48.522968 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:48.523035 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:48.523138 15421 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0513 07:33:48.523357 15421 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0513 07:33:48.523604 15421 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0513 07:33:48.530248 15421 target.go:111] Terraform output is in /tmp/test2052471055/out --- PASS: TestPrivateSharedIP (1.57s) === RUN TestPrivateDns1 I0513 07:33:48.535092 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:48.535308 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:48.535347 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:48.535386 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:48.535416 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:48.535457 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:48.535490 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:48.535511 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:48.535540 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:48.535562 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0513 07:33:48.560211 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:48.560279 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:48.560321 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:50.100709 15421 executor.go:111] Tasks: 0 done / 135 total; 46 can run I0513 07:33:50.103875 15421 executor.go:111] Tasks: 46 done / 135 total; 28 can run I0513 07:33:50.104127 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I0513 07:33:50.104166 15421 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I0513 07:33:50.104244 15421 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I0513 07:33:50.104258 15421 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I0513 07:33:50.104483 15421 executor.go:111] Tasks: 74 done / 135 total; 39 can run I0513 07:33:50.104807 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:50.105005 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:50.106922 15421 executor.go:111] Tasks: 113 done / 135 total; 6 can run W0513 07:33:50.106990 15421 api.go:53] PageSize not implemented W0513 07:33:50.107150 15421 api.go:53] PageSize not implemented I0513 07:33:50.111440 15421 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0513 07:33:50.111628 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:50.111839 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:50.112253 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:50.112329 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:50.112394 15421 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0513 07:33:50.112646 15421 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0513 07:33:50.112894 15421 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0513 07:33:50.125662 15421 target.go:111] Terraform output is in /tmp/test2250417709/out --- PASS: TestPrivateDns1 (1.60s) === RUN TestPrivateDns2 I0513 07:33:50.130595 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:50.130799 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:50.130838 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:50.130886 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:50.130921 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:50.130962 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:50.130996 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:50.131016 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:50.131045 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:50.131067 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:50.155599 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:50.155666 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:50.155706 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:51.589720 15421 executor.go:111] Tasks: 0 done / 132 total; 45 can run I0513 07:33:51.597219 15421 executor.go:111] Tasks: 45 done / 132 total; 26 can run I0513 07:33:51.597399 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I0513 07:33:51.597428 15421 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I0513 07:33:51.597503 15421 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I0513 07:33:51.597520 15421 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I0513 07:33:51.597768 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:33:51.597913 15421 executor.go:111] Tasks: 71 done / 132 total; 39 can run I0513 07:33:51.598412 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:51.598585 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:51.600475 15421 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0513 07:33:51.600618 15421 api.go:53] PageSize not implemented W0513 07:33:51.600678 15421 api.go:53] PageSize not implemented I0513 07:33:51.605023 15421 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0513 07:33:51.605178 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:51.605351 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:51.605772 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:51.605860 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:51.605945 15421 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0513 07:33:51.606198 15421 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0513 07:33:51.606452 15421 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0513 07:33:51.613257 15421 target.go:111] Terraform output is in /tmp/test1765529497/out --- PASS: TestPrivateDns2 (1.49s) === RUN TestDiscoveryFeatureGate I0513 07:33:51.618220 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:51.618413 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:51.618464 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:51.618505 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:51.618553 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:51.618596 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:51.618669 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:51.618692 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:51.618720 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:51.618742 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:51.638812 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:33:51.641453 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:51.641515 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:52.915831 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:53.098947 15421 executor.go:111] Tasks: 0 done / 113 total; 52 can run I0513 07:33:53.101963 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:53.102006 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:53.102106 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:53.104805 15421 executor.go:111] Tasks: 52 done / 113 total; 28 can run I0513 07:33:53.111034 15421 executor.go:111] Tasks: 80 done / 113 total; 25 can run I0513 07:33:53.111412 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:53.111659 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:53.111925 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:53.112362 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:53.112454 15421 executor.go:111] Tasks: 105 done / 113 total; 2 can run I0513 07:33:53.112852 15421 executor.go:111] Tasks: 107 done / 113 total; 6 can run I0513 07:33:53.113239 15421 executor.go:111] Tasks: 113 done / 113 total; 0 can run I0513 07:33:53.120229 15421 target.go:111] Terraform output is in /tmp/test1852590849/out --- PASS: TestDiscoveryFeatureGate (1.51s) === RUN TestVFSServiceAccountIssuerDiscovery I0513 07:33:53.126114 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:53.126317 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:53.126355 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:53.126403 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:53.126435 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:53.126474 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:53.126509 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:53.126529 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:53.126556 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:53.126578 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:53.145798 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:53.148387 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:53.148453 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:54.477418 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:54.635652 15421 executor.go:111] Tasks: 0 done / 104 total; 47 can run I0513 07:33:54.636931 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:54.636968 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:54.637078 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:54.639403 15421 executor.go:111] Tasks: 47 done / 104 total; 24 can run I0513 07:33:54.644233 15421 executor.go:111] Tasks: 71 done / 104 total; 25 can run I0513 07:33:54.644495 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:54.644729 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:54.645090 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:54.645160 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:54.645243 15421 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0513 07:33:54.645487 15421 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0513 07:33:54.645723 15421 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0513 07:33:54.651578 15421 target.go:111] Terraform output is in /tmp/test1179837202/out --- PASS: TestVFSServiceAccountIssuerDiscovery (1.53s) === RUN TestAWSLBController I0513 07:33:54.656596 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:54.656795 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:54.656833 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:54.656875 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:54.656907 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:54.656948 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:54.656982 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:54.657003 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:54.657034 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:54.657058 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:54.681987 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:54.684648 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:54.684736 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:55.998085 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:56.574943 15421 executor.go:111] Tasks: 0 done / 116 total; 54 can run I0513 07:33:56.575243 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:56.575289 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:56.575378 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:56.583163 15421 executor.go:111] Tasks: 54 done / 116 total; 29 can run I0513 07:33:56.589527 15421 executor.go:111] Tasks: 83 done / 116 total; 25 can run I0513 07:33:56.589783 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:56.590111 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:56.590506 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:56.590921 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:56.591056 15421 executor.go:111] Tasks: 108 done / 116 total; 2 can run I0513 07:33:56.591382 15421 executor.go:111] Tasks: 110 done / 116 total; 6 can run I0513 07:33:56.591690 15421 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0513 07:33:56.600105 15421 target.go:111] Terraform output is in /tmp/test2399264444/out --- PASS: TestAWSLBController (1.95s) === RUN TestManyAddons I0513 07:33:56.610883 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:56.611084 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:56.611123 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:56.611164 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:56.611196 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:56.611238 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:56.611271 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:56.611290 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:56.611319 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:56.611342 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:56.632274 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:56.634905 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:56.634971 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:57.959602 15421 zones.go:93] ListHostedZonesPages { } I0513 07:33:58.660957 15421 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0513 07:33:58.661772 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:33:58.661808 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:33:58.661914 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:33:58.665336 15421 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0513 07:33:58.672153 15421 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0513 07:33:58.672599 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:58.672839 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:58.673092 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:58.673485 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:58.673581 15421 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0513 07:33:58.673852 15421 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0513 07:33:58.674118 15421 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0513 07:33:58.681422 15421 target.go:111] Terraform output is in /tmp/test2200233806/out --- PASS: TestManyAddons (2.08s) === RUN TestManyAddonsCCMIRSA I0513 07:33:58.694881 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:33:58.695090 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:33:58.695129 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:33:58.695171 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:33:58.695219 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:33:58.695276 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:33:58.695312 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:33:58.695330 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:33:58.695359 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:33:58.695382 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:33:58.718140 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:33:58.720999 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:33:58.721064 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:00.044747 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:00.765228 15421 executor.go:111] Tasks: 0 done / 123 total; 59 can run I0513 07:34:00.765545 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:00.765578 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:00.765661 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:00.769446 15421 executor.go:111] Tasks: 59 done / 123 total; 30 can run I0513 07:34:00.778838 15421 executor.go:111] Tasks: 89 done / 123 total; 26 can run I0513 07:34:00.779242 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:00.779488 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:00.779664 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:00.780061 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:00.780153 15421 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0513 07:34:00.780435 15421 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0513 07:34:00.780677 15421 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0513 07:34:00.790628 15421 target.go:111] Terraform output is in /tmp/test1282834833/out --- PASS: TestManyAddonsCCMIRSA (2.11s) === RUN TestManyAddonsCCMIRSA23 I0513 07:34:00.801714 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:00.801941 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:00.801980 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:00.802021 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:00.802053 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:00.802092 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:00.802127 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:00.802149 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:00.802178 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:00.802202 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:00.823600 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0513 07:34:00.826425 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:00.826482 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:02.148577 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:02.857500 15421 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0513 07:34:02.861413 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:02.861487 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:02.861667 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:02.866795 15421 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0513 07:34:02.871431 15421 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0513 07:34:02.871891 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:02.872114 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:02.872293 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:02.872827 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:02.872955 15421 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0513 07:34:02.873258 15421 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0513 07:34:02.873505 15421 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0513 07:34:02.882446 15421 target.go:111] Terraform output is in /tmp/test1822260881/out --- PASS: TestManyAddonsCCMIRSA23 (2.10s) === RUN TestManyAddonsCCMIRSA24 I0513 07:34:02.897610 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:02.897949 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:02.898010 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:02.898094 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:02.898149 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:02.898218 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:02.898274 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:02.898309 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:02.898364 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:02.898407 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:02.919888 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:34:02.922917 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:02.922982 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:04.249055 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:04.957409 15421 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0513 07:34:04.957994 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:04.958034 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:04.958116 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:04.961938 15421 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0513 07:34:04.966952 15421 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0513 07:34:04.967255 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:04.968689 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:04.969275 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:04.969377 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:04.969490 15421 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0513 07:34:04.970066 15421 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0513 07:34:04.971204 15421 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0513 07:34:04.981678 15421 target.go:111] Terraform output is in /tmp/test413234462/out --- PASS: TestManyAddonsCCMIRSA24 (2.10s) === RUN TestManyAddonsCCMIRSA25 I0513 07:34:04.993007 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:04.993204 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:04.993243 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:04.993288 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:04.993319 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:04.993360 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:04.993395 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:04.993415 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:04.993444 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:04.993467 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:05.014360 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0513 07:34:05.016957 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:05.017016 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:06.313734 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:07.044286 15421 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0513 07:34:07.046253 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:07.046280 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:07.046361 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:07.049609 15421 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0513 07:34:07.054066 15421 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0513 07:34:07.054250 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:07.054556 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:07.054634 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:07.055185 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:07.055294 15421 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0513 07:34:07.055573 15421 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0513 07:34:07.055841 15421 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0513 07:34:07.069632 15421 target.go:111] Terraform output is in /tmp/test1540703119/out --- PASS: TestManyAddonsCCMIRSA25 (2.09s) === RUN TestManyAddonsCCMIRSA26 I0513 07:34:07.080609 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:07.080816 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:07.080854 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:07.080902 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:07.080938 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:07.080979 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:07.081016 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:07.081039 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:07.081069 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:07.081092 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:07.102567 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0513 07:34:07.105417 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:07.105473 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:08.412059 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:09.240698 15421 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0513 07:34:09.243654 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:09.243691 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:09.243775 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:09.249991 15421 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0513 07:34:09.254777 15421 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0513 07:34:09.254983 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:09.255169 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:09.255683 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:09.255758 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:09.255839 15421 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0513 07:34:09.256081 15421 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0513 07:34:09.256384 15421 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0513 07:34:09.266095 15421 target.go:111] Terraform output is in /tmp/test3878215550/out --- PASS: TestManyAddonsCCMIRSA26 (2.20s) === RUN TestManyAddonsGCE I0513 07:34:09.278272 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:34:11.415042 15421 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0513 07:34:11.415107 15421 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0513 07:34:11.415172 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W0513 07:34:11.415190 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W0513 07:34:11.415215 15421 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W0513 07:34:11.415260 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0513 07:34:11.416039 15421 executor.go:111] Tasks: 0 done / 67 total; 44 can run I0513 07:34:11.424126 15421 executor.go:111] Tasks: 44 done / 67 total; 17 can run I0513 07:34:11.429045 15421 executor.go:111] Tasks: 61 done / 67 total; 4 can run I0513 07:34:11.429940 15421 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0513 07:34:11.430103 15421 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0513 07:34:11.435472 15421 target.go:111] Terraform output is in /tmp/test383524420/out --- PASS: TestManyAddonsGCE (2.17s) === RUN TestCCM I0513 07:34:11.443648 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:11.443853 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:11.443894 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:11.443941 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:11.443974 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:11.444016 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:11.444054 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:11.444077 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:11.444107 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:11.444131 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:11.465223 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:11.468306 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:11.468374 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:12.775415 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:13.424221 15421 executor.go:111] Tasks: 0 done / 110 total; 51 can run I0513 07:34:13.425248 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:13.425290 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:13.425412 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:13.429021 15421 executor.go:111] Tasks: 51 done / 110 total; 24 can run I0513 07:34:13.433544 15421 executor.go:111] Tasks: 75 done / 110 total; 27 can run I0513 07:34:13.433855 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:13.434043 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:13.434387 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:13.434491 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:13.434585 15421 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0513 07:34:13.434788 15421 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0513 07:34:13.434969 15421 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0513 07:34:13.441979 15421 target.go:111] Terraform output is in /tmp/test1323708861/out --- PASS: TestCCM (2.01s) === RUN TestExternalDNS I0513 07:34:13.454349 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:13.454575 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:13.454614 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:13.454656 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:13.454688 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:13.454728 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:13.454762 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:13.454782 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:13.454811 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:13.454832 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:13.474817 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:13.477400 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:13.477466 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:14.787421 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:14.934408 15421 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0513 07:34:14.938844 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:14.938901 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:14.939145 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:14.943167 15421 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0513 07:34:14.948097 15421 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0513 07:34:14.948284 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:14.948800 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:14.948997 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:14.949420 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:14.949502 15421 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0513 07:34:14.949754 15421 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0513 07:34:14.950033 15421 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0513 07:34:14.955487 15421 target.go:111] Terraform output is in /tmp/test4053301497/out --- PASS: TestExternalDNS (1.51s) === RUN TestExternalDNSIRSA I0513 07:34:14.960189 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:14.960384 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:14.960431 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:14.960472 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:14.960503 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:14.960542 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:14.960575 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:14.960596 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:14.960624 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:14.960646 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:14.980565 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:14.983103 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:14.983167 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:16.303850 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:16.504075 15421 executor.go:111] Tasks: 0 done / 112 total; 51 can run I0513 07:34:16.507968 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:16.508035 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:16.508180 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:16.510342 15421 executor.go:111] Tasks: 51 done / 112 total; 28 can run I0513 07:34:16.516051 15421 executor.go:111] Tasks: 79 done / 112 total; 25 can run I0513 07:34:16.516347 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:16.516518 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:16.516714 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:16.517150 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:16.517233 15421 executor.go:111] Tasks: 104 done / 112 total; 2 can run I0513 07:34:16.517475 15421 executor.go:111] Tasks: 106 done / 112 total; 6 can run I0513 07:34:16.517724 15421 executor.go:111] Tasks: 112 done / 112 total; 0 can run I0513 07:34:16.524847 15421 target.go:111] Terraform output is in /tmp/test4231474919/out --- PASS: TestExternalDNSIRSA (1.57s) === RUN TestKarpenter I0513 07:34:16.530668 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:16.530862 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:16.530899 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:16.530943 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:16.530974 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:16.531013 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:16.531045 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:16.531066 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:16.531096 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:16.531118 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:16.555989 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:34:16.560532 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:16.560738 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:16.560804 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:17.908052 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:18.079447 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:18.079553 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:18.079636 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0513 07:34:18.182116 15421 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W0513 07:34:18.182179 15421 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0513 07:34:18.182197 15421 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W0513 07:34:18.182206 15421 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0513 07:34:18.182215 15421 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I0513 07:34:18.201725 15421 executor.go:111] Tasks: 0 done / 122 total; 54 can run I0513 07:34:18.203620 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:18.203661 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:18.203803 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:18.205032 15421 executor.go:111] Tasks: 54 done / 122 total; 31 can run I0513 07:34:18.212303 15421 executor.go:111] Tasks: 85 done / 122 total; 29 can run I0513 07:34:18.212591 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:18.213562 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:18.214654 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:18.215003 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:18.215102 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:18.215349 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:18.215470 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:18.216019 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:18.216119 15421 executor.go:111] Tasks: 114 done / 122 total; 2 can run I0513 07:34:18.216394 15421 executor.go:111] Tasks: 116 done / 122 total; 6 can run I0513 07:34:18.216619 15421 executor.go:111] Tasks: 122 done / 122 total; 0 can run I0513 07:34:18.224475 15421 target.go:111] Terraform output is in /tmp/test1339934521/out --- PASS: TestKarpenter (1.70s) === RUN TestSharedSubnet I0513 07:34:18.231765 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:18.231969 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:18.232007 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:18.232052 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:18.232083 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:18.232119 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:18.232151 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:18.232172 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:18.232201 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:18.232226 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:18.250896 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:18.253452 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:18.253515 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:19.603453 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:19.750690 15421 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0513 07:34:19.753009 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:19.753045 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:19.753121 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:19.754553 15421 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0513 07:34:19.754748 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:34:19.759073 15421 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0513 07:34:19.759244 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:19.759473 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:19.759599 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:19.760072 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:19.760166 15421 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0513 07:34:19.760455 15421 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0513 07:34:19.760717 15421 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0513 07:34:19.765965 15421 target.go:111] Terraform output is in /tmp/test609729540/out --- PASS: TestSharedSubnet (1.54s) === RUN TestSharedVPC I0513 07:34:19.770919 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:19.771117 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:19.771155 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:19.771194 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:19.771227 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:19.771308 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:19.771348 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:19.771369 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:19.771396 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:19.771420 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:19.794450 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:19.797124 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:19.797200 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:21.126522 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:21.253215 15421 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0513 07:34:21.254541 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:21.254559 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:21.254611 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:21.259230 15421 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0513 07:34:21.260755 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:34:21.266370 15421 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0513 07:34:21.266583 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:21.266757 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:21.267250 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:21.267379 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:21.267473 15421 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0513 07:34:21.267743 15421 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0513 07:34:21.267993 15421 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0513 07:34:21.273760 15421 target.go:111] Terraform output is in /tmp/test2787719775/out --- PASS: TestSharedVPC (1.51s) === RUN TestSharedVPCIPv6 I0513 07:34:21.278300 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:21.278484 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:21.278522 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:21.278583 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:21.278614 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:21.278651 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:21.278684 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:21.278704 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:21.278732 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:21.278753 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:21.280377 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:34:21.280423 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:34:21.301890 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:34:21.301937 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0513 07:34:21.302017 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:34:21.305234 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:21.305302 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:22.626698 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:22.773225 15421 executor.go:111] Tasks: 0 done / 133 total; 45 can run I0513 07:34:22.777533 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:22.777598 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:22.777757 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:22.780697 15421 executor.go:111] Tasks: 45 done / 133 total; 29 can run I0513 07:34:22.781065 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:34:22.781252 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:34:22.783534 15421 executor.go:111] Tasks: 74 done / 133 total; 37 can run I0513 07:34:22.784256 15421 executor.go:111] Tasks: 111 done / 133 total; 6 can run I0513 07:34:22.784363 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:34:22.784435 15421 loadbalancers.go:35] PageSize not implemented I0513 07:34:22.784545 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:34:22.784610 15421 loadbalancers.go:35] PageSize not implemented I0513 07:34:22.788854 15421 executor.go:111] Tasks: 117 done / 133 total; 8 can run I0513 07:34:22.789083 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:22.789239 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:22.789438 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:22.789861 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:22.789953 15421 executor.go:111] Tasks: 125 done / 133 total; 2 can run I0513 07:34:22.790217 15421 executor.go:111] Tasks: 127 done / 133 total; 6 can run I0513 07:34:22.790469 15421 executor.go:111] Tasks: 133 done / 133 total; 0 can run I0513 07:34:22.797171 15421 target.go:111] Terraform output is in /tmp/test632161249/out --- PASS: TestSharedVPCIPv6 (1.52s) === RUN TestExistingIAM I0513 07:34:22.802066 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:22.802273 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:22.802310 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:22.802356 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:22.802388 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:22.802427 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:22.802461 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:22.802482 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:22.802511 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:22.802534 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:22.832567 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:22.835712 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:22.835785 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:22.835827 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:22.835868 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:24.206351 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:24.373125 15421 executor.go:111] Tasks: 0 done / 117 total; 51 can run I0513 07:34:24.375070 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:24.375103 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:24.375190 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:24.376505 15421 executor.go:111] Tasks: 51 done / 117 total; 19 can run I0513 07:34:24.384362 15421 executor.go:111] Tasks: 70 done / 117 total; 31 can run I0513 07:34:24.384636 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:24.385061 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:24.385787 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:24.386143 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:24.386231 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:24.386409 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:24.386499 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:24.386598 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:24.386693 15421 executor.go:111] Tasks: 101 done / 117 total; 4 can run I0513 07:34:24.387051 15421 executor.go:111] Tasks: 105 done / 117 total; 12 can run I0513 07:34:24.387480 15421 executor.go:111] Tasks: 117 done / 117 total; 0 can run I0513 07:34:24.395507 15421 target.go:111] Terraform output is in /tmp/test131624160/out --- PASS: TestExistingIAM (1.60s) === RUN TestPhaseNetwork I0513 07:34:24.400780 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:24.400978 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:24.401017 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:24.401059 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:24.401092 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:24.401133 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:24.401166 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:24.401185 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:24.401216 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:24.401238 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:24.422127 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:24.424975 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:24.425119 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:24.425166 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:25.742228 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:25.890594 15421 executor.go:111] Tasks: 0 done / 135 total; 47 can run I0513 07:34:25.891051 15421 executor.go:111] Tasks: 47 done / 135 total; 30 can run I0513 07:34:25.891700 15421 executor.go:111] Tasks: 77 done / 135 total; 36 can run I0513 07:34:25.892023 15421 executor.go:111] Tasks: 113 done / 135 total; 6 can run I0513 07:34:25.892184 15421 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0513 07:34:25.892312 15421 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0513 07:34:25.892414 15421 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0513 07:34:25.892532 15421 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0513 07:34:25.894118 15421 target.go:111] Terraform output is in /tmp/test668239528/out --- PASS: TestPhaseNetwork (1.49s) === RUN TestExternalLoadBalancer I0513 07:34:25.894798 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:25.895002 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:25.895042 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:25.895085 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:25.895117 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:25.895155 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:25.895231 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:25.895259 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:25.895288 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:25.895310 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:25.915184 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:25.917801 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:25.917875 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:27.236155 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:27.382692 15421 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0513 07:34:27.384235 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:27.384274 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:27.384396 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:27.385379 15421 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0513 07:34:27.391757 15421 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0513 07:34:27.392976 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:27.394573 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:27.395673 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:27.396219 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:27.396307 15421 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0513 07:34:27.396618 15421 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0513 07:34:27.396894 15421 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0513 07:34:27.402662 15421 target.go:111] Terraform output is in /tmp/test2061935108/out --- PASS: TestExternalLoadBalancer (1.51s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I0513 07:34:27.407446 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:27.407639 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:27.407676 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:27.407740 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:27.407773 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:27.407812 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:27.407846 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:27.407867 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:27.407898 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:27.407922 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:27.433760 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:27.436679 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:27.436742 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:27.436780 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:27.436818 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:27.436853 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:27.436883 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:27.436919 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.756868 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:28.917036 15421 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0513 07:34:28.918552 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:28.918586 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:28.918686 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:28.922842 15421 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0513 07:34:28.929118 15421 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0513 07:34:28.929322 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.929484 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.929713 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.929868 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.930108 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.930176 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.930264 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.930418 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.930524 15421 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0513 07:34:28.930850 15421 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0513 07:34:28.931142 15421 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0513 07:34:28.939110 15421 target.go:111] Terraform output is in /tmp/test1158294751/out --- PASS: TestMixedInstancesASG (1.54s) === RUN TestMixedInstancesSpotASG I0513 07:34:28.944873 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:28.945069 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:28.945108 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:28.945145 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:28.945176 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:28.945236 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:28.945272 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:28.945293 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:28.945322 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:28.945350 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:28.974933 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:28.977862 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.977932 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.977973 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.978008 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.978044 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.978073 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:28.978102 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:30.305767 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:30.468415 15421 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0513 07:34:30.468706 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:30.468749 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:30.468837 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:30.471268 15421 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0513 07:34:30.475982 15421 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0513 07:34:30.476371 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:30.476622 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:30.476857 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:30.476973 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:30.477078 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:30.477235 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:30.478634 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:30.479104 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:30.479332 15421 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0513 07:34:30.480274 15421 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0513 07:34:30.481761 15421 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0513 07:34:30.490442 15421 target.go:111] Terraform output is in /tmp/test225828078/out --- PASS: TestMixedInstancesSpotASG (1.55s) === RUN TestAdditionalObjects I0513 07:34:30.496109 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:30.496304 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:30.496343 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:30.496407 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:30.496441 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:30.496480 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:30.496514 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:30.496534 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:30.496563 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:30.496585 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:30.517031 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0513 07:34:30.520064 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:30.520129 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:31.817805 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:31.961206 15421 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0513 07:34:31.961713 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:31.961744 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:31.961823 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:31.963803 15421 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0513 07:34:31.968378 15421 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0513 07:34:31.968829 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:31.969055 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:31.969216 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:31.969626 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:31.969713 15421 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0513 07:34:31.969963 15421 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0513 07:34:31.970236 15421 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0513 07:34:31.975977 15421 target.go:111] Terraform output is in /tmp/test3772050449/out --- PASS: TestAdditionalObjects (1.49s) === RUN TestContainerd I0513 07:34:31.984341 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:31.984560 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:31.984598 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:31.984640 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:31.984671 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:31.984708 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:31.984741 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:31.984761 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:31.984788 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:31.984810 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:32.003991 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:32.006463 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:32.006530 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:33.322179 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:33.464129 15421 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0513 07:34:33.464652 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:33.464671 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:33.464729 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:33.471970 15421 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0513 07:34:33.476676 15421 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0513 07:34:33.476869 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:33.477086 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:33.477472 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:33.477549 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:33.477619 15421 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0513 07:34:33.477868 15421 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0513 07:34:33.478146 15421 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0513 07:34:33.483670 15421 target.go:111] Terraform output is in /tmp/test790326071/out --- PASS: TestContainerd (1.50s) === RUN TestContainerdCustom I0513 07:34:33.488314 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:33.488514 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:33.488566 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:33.488607 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:33.488640 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:33.488680 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:33.488718 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:33.488741 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:33.488769 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:33.488791 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:33.506330 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:33.508418 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:33.508470 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.035925 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:34.185600 15421 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0513 07:34:34.186737 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:34.186776 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:34.186872 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:34.188338 15421 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0513 07:34:34.197218 15421 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0513 07:34:34.197496 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.197941 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.198109 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.198367 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.198475 15421 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0513 07:34:34.198727 15421 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0513 07:34:34.198962 15421 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0513 07:34:34.204718 15421 target.go:111] Terraform output is in /tmp/test4291125127/out --- PASS: TestContainerdCustom (0.72s) === RUN TestDockerCustom I0513 07:34:34.209279 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:34.209470 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:34.209507 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:34.209547 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:34.209580 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:34.209621 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:34.209653 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:34.209674 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:34.209702 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:34.209723 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:34.229194 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0513 07:34:34.231972 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.232039 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.759364 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:34.904628 15421 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0513 07:34:34.905762 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:34.905791 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:34.905871 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:34.908222 15421 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0513 07:34:34.914581 15421 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0513 07:34:34.914905 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.915158 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.915315 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.915736 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.915826 15421 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0513 07:34:34.916081 15421 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0513 07:34:34.916334 15421 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0513 07:34:34.921964 15421 target.go:111] Terraform output is in /tmp/test2899371378/out --- PASS: TestDockerCustom (0.72s) === RUN TestAPIServerNodes I0513 07:34:34.926687 15421 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0513 07:34:34.926710 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:34.926901 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:34.926939 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:34.926978 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:34.927009 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:34.927047 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:34.927083 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:34.927104 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:34.927132 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:34.927153 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:34.952029 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0513 07:34:34.954847 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.954916 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:34.954957 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:36.313844 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:36.456405 15421 executor.go:111] Tasks: 0 done / 114 total; 47 can run I0513 07:34:36.462375 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:36.462411 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:36.462491 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:36.464637 15421 executor.go:111] Tasks: 47 done / 114 total; 28 can run I0513 07:34:36.470274 15421 executor.go:111] Tasks: 75 done / 114 total; 27 can run I0513 07:34:36.470474 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:36.470699 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:36.470912 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:36.471090 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:36.471169 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:36.471301 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:36.471409 15421 executor.go:111] Tasks: 102 done / 114 total; 3 can run I0513 07:34:36.471680 15421 executor.go:111] Tasks: 105 done / 114 total; 9 can run I0513 07:34:36.471920 15421 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0513 07:34:36.478296 15421 target.go:111] Terraform output is in /tmp/test1038701600/out I0513 07:34:36.483402 15421 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (1.56s) === RUN TestNTHIMDSProcessor I0513 07:34:36.483509 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:36.483703 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:36.483738 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:36.483775 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:36.483805 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:36.483841 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:36.483871 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:36.483891 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:36.483918 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:36.483942 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:36.508653 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:36.511980 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:36.512098 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:37.853268 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:38.001266 15421 executor.go:111] Tasks: 0 done / 90 total; 44 can run I0513 07:34:38.002192 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:38.002228 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:38.002309 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:38.004157 15421 executor.go:111] Tasks: 44 done / 90 total; 19 can run I0513 07:34:38.008717 15421 executor.go:111] Tasks: 63 done / 90 total; 21 can run I0513 07:34:38.008952 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:38.009251 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:38.009556 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:38.009668 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:38.009774 15421 executor.go:111] Tasks: 84 done / 90 total; 2 can run I0513 07:34:38.010025 15421 executor.go:111] Tasks: 86 done / 90 total; 4 can run I0513 07:34:38.010197 15421 executor.go:111] Tasks: 90 done / 90 total; 0 can run I0513 07:34:38.015284 15421 target.go:111] Terraform output is in /tmp/test927368978/out --- PASS: TestNTHIMDSProcessor (1.54s) === RUN TestNTHIMDSProcessorIRSA I0513 07:34:38.023105 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:38.023336 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:38.023376 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:38.023420 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:38.023451 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:38.023489 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:38.023523 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:38.023543 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:38.023571 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:38.023592 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:38.044004 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:38.046666 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:38.046734 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:39.316209 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:39.495129 15421 executor.go:111] Tasks: 0 done / 101 total; 50 can run I0513 07:34:39.497923 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:39.497952 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:39.498046 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:39.499868 15421 executor.go:111] Tasks: 50 done / 101 total; 24 can run I0513 07:34:39.504497 15421 executor.go:111] Tasks: 74 done / 101 total; 21 can run I0513 07:34:39.504805 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:39.504937 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:39.505318 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:39.505427 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:39.505520 15421 executor.go:111] Tasks: 95 done / 101 total; 2 can run I0513 07:34:39.505775 15421 executor.go:111] Tasks: 97 done / 101 total; 4 can run I0513 07:34:39.506015 15421 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0513 07:34:39.512242 15421 target.go:111] Terraform output is in /tmp/test3522976771/out --- PASS: TestNTHIMDSProcessorIRSA (1.49s) === RUN TestCustomIRSA I0513 07:34:39.517572 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:39.517777 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:39.517815 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:39.517856 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:39.517885 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:39.517924 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:39.517958 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:39.517978 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:39.518008 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:39.518031 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:39.544302 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:39.547328 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:39.547396 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:40.870482 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:41.411086 15421 executor.go:111] Tasks: 0 done / 114 total; 52 can run I0513 07:34:41.412030 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:41.412073 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:41.412186 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:41.416080 15421 executor.go:111] Tasks: 52 done / 114 total; 29 can run I0513 07:34:41.425879 15421 executor.go:111] Tasks: 81 done / 114 total; 25 can run I0513 07:34:41.426212 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:41.426445 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:41.426883 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:41.427036 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:41.427174 15421 executor.go:111] Tasks: 106 done / 114 total; 2 can run I0513 07:34:41.427595 15421 executor.go:111] Tasks: 108 done / 114 total; 6 can run I0513 07:34:41.427914 15421 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0513 07:34:41.435719 15421 target.go:111] Terraform output is in /tmp/test3160437238/out --- PASS: TestCustomIRSA (1.93s) === RUN TestClusterNameDigit I0513 07:34:41.444992 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:41.445224 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:41.445266 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:41.445312 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:41.445344 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:41.445385 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:41.445420 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:41.445442 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:41.445470 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:41.445492 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:41.466670 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:34:41.469813 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:41.469879 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:42.772321 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:42.929045 15421 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0513 07:34:42.930034 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:42.930075 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:42.930196 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:42.932094 15421 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0513 07:34:42.936650 15421 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0513 07:34:42.937073 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:42.937292 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:42.937658 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:42.937745 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:42.937824 15421 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0513 07:34:42.938047 15421 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0513 07:34:42.938336 15421 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0513 07:34:42.944695 15421 target.go:111] Terraform output is in /tmp/test1472906072/out --- PASS: TestClusterNameDigit (1.50s) === RUN TestCASPriorityExpander I0513 07:34:42.950024 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:42.950254 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:42.950301 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:42.950372 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:42.950430 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:42.950499 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:42.950545 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:42.950586 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:42.950642 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:42.950682 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:42.978851 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0513 07:34:42.981945 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:42.982025 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:42.982066 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:42.982100 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0513 07:34:45.291830 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:45.459186 15421 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0513 07:34:45.461010 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:45.461059 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:45.461173 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:45.467196 15421 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0513 07:34:45.472103 15421 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0513 07:34:45.472278 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:45.472474 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:45.472650 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:45.472848 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:45.473062 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:45.473149 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:45.473243 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:45.473304 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:45.473386 15421 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0513 07:34:45.473690 15421 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0513 07:34:45.473996 15421 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0513 07:34:45.480808 15421 target.go:111] Terraform output is in /tmp/test2306289093/out --- PASS: TestCASPriorityExpander (2.54s) === RUN TestCASPriorityExpanderCustom I0513 07:34:45.486242 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:45.486445 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:45.486485 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:45.486524 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:45.486555 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:45.486597 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:45.486631 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:45.486652 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:45.486680 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:45.486703 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:34:45.514915 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0513 07:34:45.517914 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:45.517984 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:45.518025 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:45.518061 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0513 07:34:46.818100 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:46.992880 15421 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0513 07:34:46.994160 15421 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0513 07:34:46.994206 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:46.995497 15421 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0513 07:34:46.997818 15421 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0513 07:34:47.005100 15421 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0513 07:34:47.005386 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:47.005551 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:47.005798 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:47.005922 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:47.006066 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:47.006118 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:47.006240 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:47.006357 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:47.006450 15421 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0513 07:34:47.006729 15421 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0513 07:34:47.007020 15421 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0513 07:34:47.014081 15421 target.go:111] Terraform output is in /tmp/test2763287531/out --- PASS: TestCASPriorityExpanderCustom (1.53s) === RUN TestLifecycleMinimalAWS I0513 07:34:47.019987 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:34:47.020217 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:34:47.020275 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:34:47.020318 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:34:47.020351 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:34:47.020395 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:34:47.020431 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:34:47.020451 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:34:47.020484 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:34:47.020508 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0513 07:34:47.039431 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0513 07:34:47.042060 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:47.042215 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0513 07:34:48.418227 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:48.576035 15421 iamrole.go:89] ListRoles: { } I0513 07:34:48.577218 15421 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0513 07:34:48.577436 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:48.577612 15421 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.577763 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0513 07:34:48.577823 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0513 07:34:48.577861 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:48.577868 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:34:48.577930 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:34:48.578074 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:48.578254 15421 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.578347 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:34:48.578620 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0513 07:34:48.578729 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0513 07:34:48.578750 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:34:48.578972 15421 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0513 07:34:48.579182 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:48.579428 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:34:48.579684 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:34:48.579748 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:48.579872 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0513 07:34:48.579976 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0513 07:34:48.579953 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:34:48.580127 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:34:48.580674 15421 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0513 07:34:48.580839 15421 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0513 07:34:48.580842 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I0513 07:34:48.580906 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0513 07:34:48.581014 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0513 07:34:48.581004 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:48.581113 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0513 07:34:48.581068 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" } ] }], VpcId: "vpc-1" } I0513 07:34:48.581187 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:34:48.581226 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:34:48.581261 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0513 07:34:48.581379 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0513 07:34:48.581434 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:34:48.581524 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:34:48.581565 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:34:48.581597 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:34:48.581718 15421 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0513 07:34:48.581765 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0513 07:34:48.581898 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:48.582001 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0513 07:34:48.582089 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:34:48.582099 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0513 07:34:48.582167 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:34:48.582202 15421 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0513 07:34:48.582278 15421 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.582336 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" }] }], VpcId: "vpc-1" } I0513 07:34:48.582399 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:34:48.582435 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:34:48.582466 15421 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0513 07:34:48.582515 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:34:48.582733 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0513 07:34:48.585144 15421 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0513 07:34:48.585362 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0513 07:34:48.585513 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.585689 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0513 07:34:48.585808 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0513 07:34:48.585967 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.586130 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.586237 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.586340 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:34:48.586461 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0513 07:34:48.586501 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.586605 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:34:48.586674 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:34:48.586733 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0513 07:34:48.586785 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:48.586920 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:48.586999 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.587144 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0513 07:34:48.587194 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.587307 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:48.587395 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:48.587548 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0513 07:34:48.587618 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.587757 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0513 07:34:48.587875 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.587985 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:34:48.588137 15421 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0513 07:34:48.588381 15421 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0513 07:34:48.588649 15421 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0513 07:34:48.588693 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:48.588728 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:34:48.588792 15421 dns.go:235] Pre-creating DNS records I0513 07:34:48.588818 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:34:48.593275 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0513 07:34:48.595763 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:48.595831 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0513 07:34:49.943786 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:50.090432 15421 iamrole.go:89] ListRoles: { } I0513 07:34:50.091489 15421 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0513 07:34:50.092048 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:34:50.092132 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:34:50.092206 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.092330 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.092496 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.092645 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.092726 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:34:50.092759 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:34:50.092803 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:34:50.094532 15421 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0513 07:34:50.094697 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:34:50.094839 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.094941 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0513 07:34:50.095014 15421 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0513 07:34:50.094980 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.095093 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:34:50.095126 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0513 07:34:50.095292 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:34:50.095343 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:34:50.095416 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.095512 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0513 07:34:50.095620 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:34:50.099238 15421 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0513 07:34:50.099390 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:50.099489 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:34:50.099623 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:34:50.099782 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:34:50.099860 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:50.100159 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:50.100322 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:34:50.100715 15421 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0513 07:34:50.100934 15421 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0513 07:34:50.101114 15421 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0513 07:34:50.103066 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0513 07:34:50.103117 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:34:50.103145 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0513 07:34:50.103165 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:34:50.103185 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0513 07:34:50.103204 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0513 07:34:50.103226 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:34:50.103255 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0513 07:34:50.103279 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0513 07:34:50.103302 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0513 07:34:50.103331 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:34:50.103353 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:34:50.103373 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:34:50.103397 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0513 07:34:50.103417 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:34:50.103438 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:34:50.103460 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:34:50.103481 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:34:50.103502 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:34:50.103520 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0513 07:34:50.103540 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:34:50.103562 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:34:50.103585 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:34:50.103605 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0513 07:34:50.104512 15421 delete_cluster.go:128] Looking for cloud resources to delete W0513 07:34:50.104582 15421 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0513 07:34:50.104598 15421 keypairs.go:95] DescribeKeyPairs: { } I0513 07:34:50.104635 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.104672 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0513 07:34:50.104750 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.104798 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.104830 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.104870 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.104903 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.104931 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0513 07:34:50.104963 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.104997 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:34:50.105025 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0513 07:34:50.105058 15421 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0513 07:34:50.105083 15421 api.go:53] PageSize not implemented I0513 07:34:50.105101 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:34:50.105124 15421 loadbalancers.go:35] PageSize not implemented I0513 07:34:50.105139 15421 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0513 07:34:50.105161 15421 targetgroups.go:35] PageSize not implemented I0513 07:34:50.105175 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0513 07:34:50.105244 15421 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0513 07:34:50.105282 15421 iamrole.go:89] ListRoles: { } I0513 07:34:50.105319 15421 zones.go:93] ListHostedZonesPages { } I0513 07:34:50.105343 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:34:50.105376 15421 internetgateways.go:101] DescribeInternetGateways: { } I0513 07:34:50.105409 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:34:50.105434 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:nodes.minimal.example.com ok I0513 07:34:50.105832 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:34:50.105845 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0513 07:34:50.105916 15421 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0513 07:34:50.105951 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0513 07:34:50.105996 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0513 07:34:50.106058 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0513 07:34:50.105977 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok I0513 07:34:50.105988 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W0513 07:34:50.106181 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:34:50.106208 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0513 07:34:50.106250 15421 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0513 07:34:50.106306 15421 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I0513 07:34:50.106358 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0513 07:34:50.106413 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0513 07:34:50.106458 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:34:50.106499 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0513 07:34:50.106583 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:34:50.106593 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0513 07:34:50.106668 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0513 07:34:50.106710 15421 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0513 07:34:50.106683 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0513 07:34:50.106724 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0513 07:34:50.106752 15421 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0513 07:34:50.106786 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0513 07:34:50.106859 15421 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0513 07:34:50.106873 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0513 07:34:50.106900 15421 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0513 07:34:50.106978 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0513 07:34:50.107075 15421 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0513 07:34:50.107135 15421 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (3.09s) === RUN TestLifecycleMinimalOpenstack I0513 07:34:50.107637 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I0513 07:34:50.114152 15421 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:34:51.543869 15421 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0513 07:34:51.543907 15421 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0513 07:34:51.557885 15421 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/05/13 07:34:51 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:34:51 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0513 07:34:51.564214 15421 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0513 07:34:51.573883 15421 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0513 07:34:51.577979 15421 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/05/13 07:34:51 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:34:51 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:34:51 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0513 07:34:51.583785 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0513 07:34:51.583790 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0513 07:34:51.584245 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0513 07:34:52.589653 15421 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:34:54.006959 15421 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0513 07:34:54.006997 15421 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0513 07:34:54.022379 15421 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/05/13 07:34:54 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:34:54 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0513 07:34:54.032380 15421 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0513 07:34:54.037896 15421 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0513 07:34:54.039341 15421 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/05/13 07:34:54 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:34:54 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:34:54 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0513 07:34:54.041716 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0513 07:34:54.042288 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0513 07:34:54.042423 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0513 07:34:54.042730 15421 executor.go:111] Tasks: 92 done / 92 total; 0 can run I0513 07:34:54.043892 15421 delete_cluster.go:128] Looking for cloud resources to delete 2025/05/13 07:34:54 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Subnet:1713d27d-9114-4956-b1b3-d3064083da24 ok Port:1a63a2e2-2591-4b86-88e5-f4027ff32a09 ok SecurityGroup:4d7cd2b2-67ea-44c5-8bde-9e1fc82ca310 ok ServerGroup:ec350f0c-59aa-4f65-8dae-d583f858b0b5 ok Instance:fa8db5d8-6639-4e16-a375-a312015b9783 ok Port:057ab164-2b55-418d-8369-68707e7f3346 ok Port:5871fa5d-582c-4a37-a39b-ef4efe9ad53d ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok ServerGroup:32efca70-0d71-4b04-8956-33d975b138fe ok Instance:612ba446-4afd-42a2-999a-afe3b0985349 ok SecurityGroup:bc20affb-900f-4e0c-a339-a62ca666d980 ok Network:fe76fd99-105d-40e1-8283-bb3e6b532afa ok SecurityGroup:c8c5cab7-f1a0-4ecc-a47f-7452e98e3e46 ok Instance:33aecbd4-8343-496b-899b-5f1cfb8e2093 ok --- PASS: TestLifecycleMinimalOpenstack (5.05s) === RUN TestLifecycleMinimalGCE I0513 07:34:55.159751 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I0513 07:34:55.161284 15421 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:34:56.868596 15421 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0513 07:34:56.868706 15421 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0513 07:34:56.868832 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0513 07:34:56.868862 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0513 07:34:56.868897 15421 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0513 07:34:56.868975 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0513 07:34:56.870014 15421 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0513 07:34:56.873635 15421 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0513 07:34:56.877999 15421 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0513 07:34:56.878800 15421 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0513 07:34:56.878989 15421 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0513 07:34:56.879073 15421 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:34:58.649569 15421 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0513 07:34:58.649652 15421 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0513 07:34:58.649738 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0513 07:34:58.649755 15421 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0513 07:34:58.649773 15421 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0513 07:34:58.649827 15421 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0513 07:34:58.650872 15421 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0513 07:34:58.653502 15421 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0513 07:34:58.658766 15421 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0513 07:34:58.659835 15421 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0513 07:34:58.659984 15421 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0513 07:34:58.661214 15421 delete_cluster.go:128] Looking for cloud resources to delete I0513 07:34:58.661276 15421 gce.go:99] Scanning zones: [us-test1-a] I0513 07:34:58.661598 15421 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I0513 07:34:58.661616 15421 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:ssh-external-to-master-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1747121696 ok InstanceTemplate:nodes-minimal-gce-example-com-1747121696 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (3.50s) === RUN TestLifecycleFloatingIPOpenstack I0513 07:34:58.662869 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I0513 07:34:58.669248 15421 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:35:00.109848 15421 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0513 07:35:00.109877 15421 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0513 07:35:00.125510 15421 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/05/13 07:35:00 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:35:00 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0513 07:35:00.129924 15421 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0513 07:35:00.142610 15421 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0513 07:35:00.145492 15421 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/05/13 07:35:00 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:35:00 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:35:00 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0513 07:35:00.147556 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0513 07:35:00.147698 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0513 07:35:00.147738 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0513 07:35:01.151907 15421 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0513 07:35:02.561667 15421 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0513 07:35:02.561696 15421 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0513 07:35:02.573141 15421 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/05/13 07:35:02 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:35:02 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0513 07:35:02.581453 15421 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0513 07:35:02.586110 15421 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0513 07:35:02.587506 15421 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/05/13 07:35:02 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:35:02 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/05/13 07:35:02 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0513 07:35:02.589280 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0513 07:35:02.590142 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0513 07:35:02.590229 15421 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0513 07:35:02.590530 15421 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0513 07:35:02.591836 15421 delete_cluster.go:128] Looking for cloud resources to delete 2025/05/13 07:35:02 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Port:5f04fc6b-4637-4106-9910-7350139d6672 ok Router:7529f179-ecbd-41f9-8953-04f301405f5a ok Router-IF:1032b26c-2a4d-4269-a4ab-b958222947bc ok SecurityGroup:6319b4cb-64d2-4389-bad1-65a81b861d90 ok ServerGroup:500dd131-05e3-4c34-b092-d5096ef47d78 ok ServerGroup:8a5307a4-6429-4203-bd2c-72a057ad4787 ok Subnet:1032b26c-2a4d-4269-a4ab-b958222947bc ok Network:252c3385-ff0f-4a7e-bf47-0634f4474383 ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Instance:6be2ed6c-86a9-4357-82c2-f7c2cad326d9 ok Instance:b07193fa-e4e9-4e8c-a7da-76e105d9d772 ok SecurityGroup:b5cacf4d-8fe7-40a6-ac21-58b3707d32e6 ok Port:d4687668-dc4c-4ee9-b465-b0cc8a3977f4 ok SecurityGroup:94244a7a-3396-4cb4-8826-1c5ad5439aeb ok Port:975b33a4-515d-434b-9196-c4ea916bcdb9 ok Instance:613052f2-cbfa-4687-b5b6-1aa4de47c5ab ok Port:6d76b326-95f9-43c2-808d-e8023edffcce ok --- PASS: TestLifecycleFloatingIPOpenstack (5.04s) === RUN TestLifecyclePrivateCalico I0513 07:35:03.702708 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:35:03.702937 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:35:03.702978 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:35:03.703024 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:35:03.703057 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:35:03.703097 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:35:03.703131 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:35:03.703152 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:35:03.703180 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:35:03.703202 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I0513 07:35:03.725714 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:35:03.728707 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:03.728859 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:03.728898 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:05.056961 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:05.388587 15421 iamrole.go:89] ListRoles: { } I0513 07:35:05.389634 15421 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0513 07:35:05.389798 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:05.389954 15421 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" }] }] } I0513 07:35:05.390056 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0513 07:35:05.390078 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0513 07:35:05.389996 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0513 07:35:05.391583 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0513 07:35:05.390094 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:05.391751 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:05.393492 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:05.393889 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I0513 07:35:05.394060 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0513 07:35:05.393870 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:05.395047 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:05.395252 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:05.395399 15421 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.395516 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:05.395642 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:05.396308 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0513 07:35:05.396371 15421 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0513 07:35:05.396416 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0513 07:35:05.396458 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:05.396501 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:05.396599 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:05.397028 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:05.398511 15421 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0513 07:35:05.398642 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:05.398701 15421 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0513 07:35:05.398740 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:05.398812 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0513 07:35:05.398888 15421 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0513 07:35:05.398856 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0513 07:35:05.398932 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0513 07:35:05.398962 15421 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0513 07:35:05.399053 15421 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0513 07:35:05.399109 15421 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0513 07:35:05.399072 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:05.399189 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0513 07:35:05.399184 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:05.399250 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:05.399300 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0513 07:35:05.399283 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:05.399381 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0513 07:35:05.399413 15421 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0513 07:35:05.399443 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:05.399603 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0513 07:35:05.399580 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0513 07:35:05.399595 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0513 07:35:05.399651 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0513 07:35:05.399763 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:05.399830 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] }] } I0513 07:35:05.399918 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:05.400005 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0513 07:35:05.400091 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:05.400175 15421 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.400232 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0513 07:35:05.400228 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0513 07:35:05.400325 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:05.400359 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:05.400386 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:05.400454 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:05.400484 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:05.400512 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0513 07:35:05.400602 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], VpcId: "vpc-1" } I0513 07:35:05.400631 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0513 07:35:05.400733 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0513 07:35:05.400766 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatecalico.example.com" }] }], VpcId: "vpc-1" } I0513 07:35:05.400828 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0513 07:35:05.400865 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0513 07:35:05.400649 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0513 07:35:05.400903 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0513 07:35:05.400933 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:05.400960 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:05.400988 15421 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0513 07:35:05.401060 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0513 07:35:05.401089 15421 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] } I0513 07:35:05.401139 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:05.401189 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:05.401222 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:05.401283 15421 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0513 07:35:05.401387 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:05.401508 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } W0513 07:35:05.401554 15421 api.go:53] PageSize not implemented I0513 07:35:05.401607 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:05.401667 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:05.401559 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0513 07:35:05.401652 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:05.401758 15421 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0513 07:35:05.401749 15421 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I0513 07:35:05.401809 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:05.401835 15421 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0513 07:35:05.401792 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.401892 15421 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0513 07:35:05.401931 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0513 07:35:05.402032 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:05.402110 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:05.402226 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I0513 07:35:05.402382 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0513 07:35:05.402505 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.402607 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.402727 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0513 07:35:05.402815 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.402939 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" }] }] } I0513 07:35:05.403046 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:05.403106 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:05.403201 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:05.403302 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:05.403341 15421 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.403399 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:05.403470 15421 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } I0513 07:35:05.403444 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" }] }] } W0513 07:35:05.403559 15421 api.go:53] PageSize not implemented I0513 07:35:05.403577 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:05.403580 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0513 07:35:05.403679 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.403777 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0513 07:35:05.403844 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.403942 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" }] }] } I0513 07:35:05.404037 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0513 07:35:05.404068 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0513 07:35:05.404097 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0513 07:35:05.404132 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0513 07:35:05.404200 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.404288 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.404373 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0513 07:35:05.404463 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I0513 07:35:05.404553 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.404639 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.404738 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0513 07:35:05.404814 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0513 07:35:05.404905 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0513 07:35:05.405000 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0513 07:35:05.405029 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0513 07:35:05.405056 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0513 07:35:05.405122 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0513 07:35:05.405235 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" }] }] } I0513 07:35:05.405353 15421 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0513 07:35:05.405410 15421 api.go:53] PageSize not implemented W0513 07:35:05.405437 15421 api.go:53] PageSize not implemented I0513 07:35:05.405426 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:05.405490 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:05.405493 15421 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:05.405491 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:05.405611 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:05.405590 15421 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0513 07:35:05.405678 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0513 07:35:05.405707 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:05.405576 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:05.405733 15421 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0513 07:35:05.405769 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:05.405890 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:05.409887 15421 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0513 07:35:05.410051 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:05.410154 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0513 07:35:05.410240 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:05.410330 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:05.410408 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:05.410511 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:05.410938 15421 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0513 07:35:05.411134 15421 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0513 07:35:05.411365 15421 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0513 07:35:05.411406 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:05.411434 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:05.411484 15421 dns.go:235] Pre-creating DNS records I0513 07:35:05.411504 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:05.416668 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:35:05.419623 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:05.419679 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:05.419721 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:06.777809 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:07.133135 15421 iamrole.go:89] ListRoles: { } I0513 07:35:07.134721 15421 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0513 07:35:07.135036 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.135143 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:07.135168 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:07.135247 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:07.135411 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:07.135761 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:07.135888 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.135998 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.136151 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.137705 15421 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0513 07:35:07.137796 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.137963 15421 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0513 07:35:07.137949 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0513 07:35:07.138022 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0513 07:35:07.138051 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0513 07:35:07.137927 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.138004 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0513 07:35:07.138161 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] }] } I0513 07:35:07.138277 15421 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0513 07:35:07.138300 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:07.138330 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.138420 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:07.138454 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0513 07:35:07.138616 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0513 07:35:07.138668 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0513 07:35:07.138772 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:07.138808 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0513 07:35:07.138906 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:07.138943 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:07.139016 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.139108 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:07.139173 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0513 07:35:07.139268 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:07.139372 15421 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0513 07:35:07.139485 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:07.139554 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:07.139627 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:07.139581 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:07.139643 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } W0513 07:35:07.139673 15421 api.go:53] PageSize not implemented I0513 07:35:07.139675 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0513 07:35:07.139704 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0513 07:35:07.139739 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0513 07:35:07.139672 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:07.139768 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0513 07:35:07.139701 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:07.139789 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } W0513 07:35:07.139837 15421 api.go:53] PageSize not implemented I0513 07:35:07.139864 15421 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0513 07:35:07.139905 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:07.139920 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0513 07:35:07.139932 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:07.139969 15421 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0513 07:35:07.140070 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:07.140262 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:07.140346 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:07.140425 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:07.140809 15421 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0513 07:35:07.140887 15421 api.go:53] PageSize not implemented I0513 07:35:07.140881 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:07.140917 15421 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0513 07:35:07.140920 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:07.140937 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:07.140961 15421 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0513 07:35:07.140978 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:07.140996 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:07.141090 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } W0513 07:35:07.141048 15421 api.go:53] PageSize not implemented I0513 07:35:07.141194 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:07.141254 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:07.145896 15421 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0513 07:35:07.146044 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:07.146131 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:07.146280 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:07.146324 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:07.146454 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:07.146849 15421 executor.go:111] Tasks: 134 done / 142 total; 2 can run W0513 07:35:07.146930 15421 api.go:53] PageSize not implemented I0513 07:35:07.146945 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:07.147096 15421 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0513 07:35:07.147297 15421 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0513 07:35:07.149959 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0513 07:35:07.150013 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:07.150041 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0513 07:35:07.150062 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0513 07:35:07.150085 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:07.150105 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0513 07:35:07.150145 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0513 07:35:07.150165 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:07.150187 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0513 07:35:07.150210 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0513 07:35:07.150233 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0513 07:35:07.150263 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0513 07:35:07.150287 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0513 07:35:07.150310 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:35:07.150329 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:35:07.150350 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:07.150372 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0513 07:35:07.150393 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0513 07:35:07.150415 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:07.150437 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:07.150458 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:07.150481 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0513 07:35:07.150503 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:07.150535 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:07.150556 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0513 07:35:07.150577 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:35:07.150598 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0513 07:35:07.150618 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:07.150651 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:07.150674 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:07.150696 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0513 07:35:07.151900 15421 delete_cluster.go:128] Looking for cloud resources to delete W0513 07:35:07.151958 15421 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0513 07:35:07.151972 15421 keypairs.go:95] DescribeKeyPairs: { } I0513 07:35:07.152006 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.152049 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0513 07:35:07.152098 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.152145 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.152179 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.152217 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.152248 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.152278 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0513 07:35:07.152318 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.152355 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:07.152376 15421 natgateway.go:117] DescribeNatGateways: { } I0513 07:35:07.152406 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0513 07:35:07.152434 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W0513 07:35:07.152471 15421 api.go:53] PageSize not implemented I0513 07:35:07.152485 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0513 07:35:07.152512 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:07.152531 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:07.152543 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0513 07:35:07.152570 15421 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0513 07:35:07.152590 15421 targetgroups.go:35] PageSize not implemented I0513 07:35:07.152603 15421 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" ] } I0513 07:35:07.152643 15421 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0513 07:35:07.152677 15421 iamrole.go:89] ListRoles: { } I0513 07:35:07.152714 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:07.152736 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:07.152775 15421 internetgateways.go:101] DescribeInternetGateways: { } I0513 07:35:07.152813 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:07.152845 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0513 07:35:07.152874 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0513 07:35:07.152902 15421 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0513 07:35:07.153394 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0513 07:35:07.153445 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok I0513 07:35:07.153419 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } autoscaling-group:nodes.privatecalico.example.com ok autoscaling-group:bastion.privatecalico.example.com ok I0513 07:35:07.153546 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0513 07:35:07.153579 15421 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I0513 07:35:07.153487 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } I0513 07:35:07.153616 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } iam-instance-profile:nodes.privatecalico.example.com ok W0513 07:35:07.153637 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok I0513 07:35:07.153651 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0513 07:35:07.153629 15421 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0513 07:35:07.153666 15421 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } load-balancer:api-privatecalico-example-0uch4k ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I0513 07:35:07.153513 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.privatecalico.example.com ok I0513 07:35:07.153689 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0513 07:35:07.153760 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I0513 07:35:07.153702 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0513 07:35:07.153869 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:07.153889 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0513 07:35:07.153917 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0513 07:35:07.153968 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0513 07:35:07.154008 15421 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok I0513 07:35:07.154066 15421 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0513 07:35:07.154131 15421 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-2 ok autoscaling-config:lt-3 ok I0513 07:35:07.154182 15421 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0513 07:35:07.154232 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0513 07:35:07.154261 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:07.154300 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W0513 07:35:07.154396 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:07.154408 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0513 07:35:07.154484 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I0513 07:35:07.154521 15421 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I0513 07:35:07.154495 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I0513 07:35:07.154535 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0513 07:35:07.154554 15421 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } I0513 07:35:07.154568 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } elastic-ip:eipalloc-1 ok I0513 07:35:07.154627 15421 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I0513 07:35:07.154640 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0513 07:35:07.154629 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } subnet:subnet-1 ok I0513 07:35:07.154664 15421 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I0513 07:35:07.154698 15421 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I0513 07:35:07.154749 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I0513 07:35:07.154794 15421 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I0513 07:35:07.154807 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0513 07:35:07.154830 15421 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I0513 07:35:07.154675 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W0513 07:35:07.154880 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:07.154899 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0513 07:35:07.154935 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0513 07:35:07.155017 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0513 07:35:07.155064 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0513 07:35:07.155120 15421 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0513 07:35:07.155176 15421 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (3.45s) === RUN TestLifecyclePrivateKopeio I0513 07:35:07.155701 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:35:07.155911 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:35:07.155942 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:35:07.155976 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:35:07.156005 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:35:07.156041 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:35:07.156074 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:35:07.156096 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:35:07.156127 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:35:07.156147 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I0513 07:35:07.177862 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:07.180379 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:07.180498 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:07.180537 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:08.511648 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:08.664814 15421 iamrole.go:89] ListRoles: { } I0513 07:35:08.666491 15421 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0513 07:35:08.666689 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["privatekopeio.example.com"] }] } I0513 07:35:08.666840 15421 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0513 07:35:08.666910 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0513 07:35:08.666941 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0513 07:35:08.666966 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:08.667001 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:08.666963 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:08.666975 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0513 07:35:08.667057 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0513 07:35:08.667101 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:08.667260 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:08.667368 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:08.667408 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:08.667531 15421 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.667636 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:08.667630 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0513 07:35:08.667725 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0513 07:35:08.667755 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:08.667842 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:08.667880 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0513 07:35:08.667877 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:08.667954 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.privatekopeio.example.com" }] } I0513 07:35:08.668008 15421 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.668078 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:08.669383 15421 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0513 07:35:08.669507 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0513 07:35:08.669502 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0513 07:35:08.669651 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0513 07:35:08.669699 15421 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0513 07:35:08.669654 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:08.669755 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0513 07:35:08.669729 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0513 07:35:08.669816 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0513 07:35:08.669761 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0513 07:35:08.669926 15421 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0513 07:35:08.669953 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0513 07:35:08.670026 15421 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0513 07:35:08.670000 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:08.670088 15421 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0513 07:35:08.670168 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0513 07:35:08.670214 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0513 07:35:08.670227 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:08.670288 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0513 07:35:08.670397 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:08.670398 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0513 07:35:08.670481 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0513 07:35:08.670573 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0513 07:35:08.670562 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:08.670642 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0513 07:35:08.670717 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0513 07:35:08.670755 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:08.670727 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0513 07:35:08.670782 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:08.670888 15421 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0513 07:35:08.670924 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:08.670990 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:08.671025 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:08.671057 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:08.671178 15421 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0513 07:35:08.671238 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0513 07:35:08.671315 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0513 07:35:08.671387 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:08.671453 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0513 07:35:08.671503 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0513 07:35:08.671526 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] }] } I0513 07:35:08.671593 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:08.671661 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0513 07:35:08.671466 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0513 07:35:08.671696 15421 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0513 07:35:08.671658 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0513 07:35:08.671751 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:08.671794 15421 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0513 07:35:08.671853 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:08.671932 15421 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0513 07:35:08.672013 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatekopeio.example.com" }] }], VpcId: "vpc-1" } I0513 07:35:08.672112 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:08.672169 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:08.672222 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0513 07:35:08.672258 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:08.672295 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:08.672373 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:08.672412 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:08.672447 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:08.672480 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:08.672507 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0513 07:35:08.672542 15421 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] } I0513 07:35:08.672595 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:08.672651 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0513 07:35:08.672680 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0513 07:35:08.672715 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0513 07:35:08.672746 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0513 07:35:08.672819 15421 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0513 07:35:08.672952 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:08.673021 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0513 07:35:08.673115 15421 api.go:53] PageSize not implemented I0513 07:35:08.673092 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:08.673212 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:08.673199 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:08.673258 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:08.673255 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:08.673342 15421 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0513 07:35:08.673256 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.673392 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:08.673415 15421 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0513 07:35:08.673333 15421 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-2" },{ SubnetId: "subnet-3" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I0513 07:35:08.673457 15421 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0513 07:35:08.673494 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:08.673518 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:08.673554 15421 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W0513 07:35:08.673616 15421 api.go:53] PageSize not implemented I0513 07:35:08.673630 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:08.673650 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0513 07:35:08.673764 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.673907 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.674006 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0513 07:35:08.674123 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0513 07:35:08.674222 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0513 07:35:08.674256 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" }] }] } I0513 07:35:08.674347 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:08.674410 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0513 07:35:08.674440 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0513 07:35:08.674495 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:08.674580 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:35:08.674638 15421 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0513 07:35:08.674680 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0513 07:35:08.674730 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:08.674797 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0513 07:35:08.674953 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.675070 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:08.675130 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0513 07:35:08.675185 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.675318 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.675406 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.675492 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0513 07:35:08.675522 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0513 07:35:08.675548 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.675645 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0513 07:35:08.675674 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I0513 07:35:08.675741 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.675834 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.675924 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.676013 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.676101 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0513 07:35:08.676199 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0513 07:35:08.676262 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0513 07:35:08.676407 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.676502 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0513 07:35:08.676528 15421 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0513 07:35:08.676561 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0513 07:35:08.676590 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0513 07:35:08.676654 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0513 07:35:08.676739 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0513 07:35:08.676770 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:35:08.676801 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0513 07:35:08.676902 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0513 07:35:08.676966 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I0513 07:35:08.676995 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0513 07:35:08.677031 15421 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0513 07:35:08.677078 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I0513 07:35:08.677139 15421 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0513 07:35:08.677185 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0513 07:35:08.677238 15421 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0513 07:35:08.677275 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:08.677331 15421 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0513 07:35:08.677407 15421 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0513 07:35:08.677498 15421 api.go:53] PageSize not implemented I0513 07:35:08.677535 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:08.677498 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:08.677488 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:08.677631 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-1" } W0513 07:35:08.677670 15421 api.go:53] PageSize not implemented I0513 07:35:08.677680 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:08.677715 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:08.677677 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:08.677773 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-3" } I0513 07:35:08.677820 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:08.677892 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:08.681950 15421 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0513 07:35:08.682129 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:08.682270 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:08.682353 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:08.682470 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:08.683114 15421 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0513 07:35:08.683356 15421 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0513 07:35:08.683573 15421 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0513 07:35:08.683628 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:08.683677 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:08.683757 15421 dns.go:235] Pre-creating DNS records I0513 07:35:08.683789 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:08.692903 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:08.695877 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:08.696127 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:08.696201 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:10.076729 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:10.227296 15421 iamrole.go:89] ListRoles: { } I0513 07:35:10.228710 15421 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0513 07:35:10.229100 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:10.229267 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:10.229354 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.229470 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:10.229498 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:10.229540 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:10.229570 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.229682 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.229783 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.230917 15421 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0513 07:35:10.231031 15421 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0513 07:35:10.231054 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:10.231192 15421 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0513 07:35:10.231215 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0513 07:35:10.231161 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.231194 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0513 07:35:10.231286 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0513 07:35:10.231328 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0513 07:35:10.231286 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.231427 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.231540 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:10.231573 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0513 07:35:10.231704 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:10.231755 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:10.231858 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.232033 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:10.232072 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.232185 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0513 07:35:10.232284 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0513 07:35:10.232322 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] }] } I0513 07:35:10.232408 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.232497 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:10.232523 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0513 07:35:10.232614 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:10.232653 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.232740 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0513 07:35:10.232766 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0513 07:35:10.232856 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:10.232929 15421 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0513 07:35:10.233000 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:10.233077 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0513 07:35:10.233099 15421 api.go:53] PageSize not implemented I0513 07:35:10.233126 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:10.233120 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:10.233197 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:10.233230 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:10.233193 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:10.233304 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:10.233329 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0513 07:35:10.233266 15421 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0513 07:35:10.233386 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0513 07:35:10.233425 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0513 07:35:10.233253 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:10.233459 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0513 07:35:10.233546 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0513 07:35:10.233583 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } W0513 07:35:10.233677 15421 api.go:53] PageSize not implemented I0513 07:35:10.233694 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:10.233720 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:10.233835 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:10.233923 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:10.234219 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0513 07:35:10.234413 15421 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0513 07:35:10.234492 15421 api.go:53] PageSize not implemented I0513 07:35:10.234476 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:10.234512 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:10.234565 15421 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0513 07:35:10.234543 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:10.234528 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:10.234585 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:10.234636 15421 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0513 07:35:10.234662 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } W0513 07:35:10.234746 15421 api.go:53] PageSize not implemented I0513 07:35:10.234782 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:10.234852 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:10.243079 15421 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0513 07:35:10.243249 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:10.243381 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:10.243532 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:10.243682 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:10.244279 15421 executor.go:111] Tasks: 136 done / 144 total; 2 can run W0513 07:35:10.244389 15421 api.go:53] PageSize not implemented I0513 07:35:10.244413 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:10.244574 15421 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0513 07:35:10.244787 15421 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0513 07:35:10.247947 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0513 07:35:10.248001 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:10.248031 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0513 07:35:10.248052 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:10.248074 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0513 07:35:10.248094 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0513 07:35:10.248124 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:10.248148 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0513 07:35:10.248173 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0513 07:35:10.248197 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0513 07:35:10.248229 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0513 07:35:10.248255 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:35:10.248279 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:35:10.248301 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:10.248326 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0513 07:35:10.248348 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0513 07:35:10.248370 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0513 07:35:10.248394 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:10.248418 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:10.248441 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:10.248465 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0513 07:35:10.248489 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:10.248514 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:10.248550 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0513 07:35:10.248575 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0513 07:35:10.248599 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0513 07:35:10.248624 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:35:10.248646 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0513 07:35:10.248668 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:10.248691 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:10.248716 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:10.248739 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0513 07:35:10.250065 15421 delete_cluster.go:128] Looking for cloud resources to delete W0513 07:35:10.250126 15421 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0513 07:35:10.250143 15421 keypairs.go:95] DescribeKeyPairs: { } I0513 07:35:10.250176 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.250222 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0513 07:35:10.250273 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.250319 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.250352 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.250392 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.250423 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.250457 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0513 07:35:10.250505 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.250554 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:10.250578 15421 natgateway.go:117] DescribeNatGateways: { } I0513 07:35:10.250607 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0513 07:35:10.250637 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W0513 07:35:10.250674 15421 api.go:53] PageSize not implemented I0513 07:35:10.250687 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0513 07:35:10.250716 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:10.250735 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:10.250747 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0513 07:35:10.250775 15421 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0513 07:35:10.250793 15421 targetgroups.go:35] PageSize not implemented I0513 07:35:10.250805 15421 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" ] } I0513 07:35:10.250850 15421 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0513 07:35:10.250881 15421 iamrole.go:89] ListRoles: { } I0513 07:35:10.250924 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:10.250945 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:10.250976 15421 internetgateways.go:101] DescribeInternetGateways: { } I0513 07:35:10.251014 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:10.251054 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1","rtb-3"] } I0513 07:35:10.251087 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0513 07:35:10.251110 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } autoscaling-config:lt-3 ok autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I0513 07:35:10.251628 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.privatekopeio.example.com ok autoscaling-group:bastion.privatekopeio.example.com ok I0513 07:35:10.251710 15421 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0513 07:35:10.251680 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W0513 07:35:10.251790 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:10.251764 15421 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } autoscaling-config:lt-1 ok I0513 07:35:10.251810 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } I0513 07:35:10.251790 15421 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } security-group:sg-1 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok I0513 07:35:10.251783 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok I0513 07:35:10.251838 15421 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0513 07:35:10.251886 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } load-balancer:api-privatekopeio-example-tl2bv8 ok I0513 07:35:10.251918 15421 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0513 07:35:10.251912 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0513 07:35:10.251951 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok I0513 07:35:10.251955 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0513 07:35:10.251974 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0513 07:35:10.252009 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok iam-instance-profile:masters.privatekopeio.example.com ok I0513 07:35:10.251896 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.privatekopeio.example.com. ok I0513 07:35:10.252017 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } W0513 07:35:10.252167 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:10.252187 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0513 07:35:10.252222 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0513 07:35:10.252262 15421 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok I0513 07:35:10.252348 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0513 07:35:10.252426 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:10.252469 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0513 07:35:10.252627 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:10.252639 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0513 07:35:10.252734 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0513 07:35:10.252747 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I0513 07:35:10.252792 15421 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0513 07:35:10.252783 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0513 07:35:10.252807 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0513 07:35:10.252833 15421 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I0513 07:35:10.252857 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I0513 07:35:10.252825 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0513 07:35:10.252890 15421 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0513 07:35:10.252927 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0513 07:35:10.252991 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0513 07:35:10.253004 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:10.253028 15421 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I0513 07:35:10.253065 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I0513 07:35:10.253098 15421 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I0513 07:35:10.253045 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I0513 07:35:10.253108 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } W0513 07:35:10.253123 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:10.253126 15421 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I0513 07:35:10.253134 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0513 07:35:10.253195 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0513 07:35:10.253244 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0513 07:35:10.253283 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0513 07:35:10.253343 15421 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0513 07:35:10.253398 15421 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (3.10s) === RUN TestLifecycleIPv6 I0513 07:35:10.253877 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:35:10.254081 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:35:10.254115 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:35:10.254147 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:35:10.254174 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:35:10.254209 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:35:10.254240 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:35:10.254260 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:35:10.254289 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:35:10.254309 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I0513 07:35:10.276904 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:35:10.279962 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:10.280022 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:11.641036 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:11.779638 15421 iamrole.go:89] ListRoles: { } I0513 07:35:11.780816 15421 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0513 07:35:11.781791 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0513 07:35:11.782653 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.783050 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:11.783355 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:11.781931 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0513 07:35:11.783710 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0513 07:35:11.783850 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0513 07:35:11.783856 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.784243 15421 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.784429 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0513 07:35:11.784544 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0513 07:35:11.784606 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:11.784716 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:11.784780 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.785035 15421 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.785216 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:11.785293 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.785562 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:11.785814 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:11.785911 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:11.786926 15421 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.786514 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:11.788651 15421 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0513 07:35:11.788762 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:11.788818 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0513 07:35:11.788875 15421 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0513 07:35:11.788901 15421 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0513 07:35:11.788954 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.789015 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0513 07:35:11.788964 15421 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0513 07:35:11.789035 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0513 07:35:11.789076 15421 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0513 07:35:11.789117 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0513 07:35:11.789150 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.789257 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0513 07:35:11.789353 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0513 07:35:11.789383 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0513 07:35:11.789533 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:11.789599 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:11.789642 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:11.789613 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0513 07:35:11.789683 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.789779 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0513 07:35:11.789872 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0513 07:35:11.789861 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0513 07:35:11.789957 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0513 07:35:11.789890 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.790083 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:11.790170 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.790296 15421 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0513 07:35:11.790375 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:11.790441 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0513 07:35:11.790499 15421 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0513 07:35:11.790596 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0513 07:35:11.790444 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0513 07:35:11.790747 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0513 07:35:11.790901 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:11.790971 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:11.791041 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:11.791077 15421 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0513 07:35:11.791133 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:11.791175 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:11.791219 15421 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0513 07:35:11.791291 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0513 07:35:11.791344 15421 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] } I0513 07:35:11.791402 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:11.791462 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:11.791497 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:11.791572 15421 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0513 07:35:11.791704 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.791830 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.792008 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0513 07:35:11.792127 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.792300 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I0513 07:35:11.792476 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" }] }] } I0513 07:35:11.792589 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:11.792712 15421 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.792800 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0513 07:35:11.792899 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I0513 07:35:11.793018 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.793097 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.793161 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.793173 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0513 07:35:11.793227 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0513 07:35:11.793265 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0513 07:35:11.793310 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:11.793317 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0513 07:35:11.793394 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:11.793464 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I0513 07:35:11.793517 15421 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.793564 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0513 07:35:11.793692 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:11.793788 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I0513 07:35:11.793824 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:11.793930 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-1" } I0513 07:35:11.794045 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.794201 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:11.794294 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.794397 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:11.794441 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0513 07:35:11.794528 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0513 07:35:11.794483 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0513 07:35:11.794630 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.794773 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0513 07:35:11.794893 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.795007 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.795140 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I0513 07:35:11.795184 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0513 07:35:11.795300 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0513 07:35:11.795398 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0513 07:35:11.795501 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:11.795541 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:11.795571 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.795692 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.795814 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0513 07:35:11.795852 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0513 07:35:11.795901 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0513 07:35:11.795959 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0513 07:35:11.796002 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0513 07:35:11.796122 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0513 07:35:11.796159 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:11.796195 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0513 07:35:11.796257 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:11.796317 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0513 07:35:11.796359 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0513 07:35:11.796436 15421 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0513 07:35:11.796505 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:11.796524 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:11.796581 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:11.796579 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:11.796655 15421 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-3" },{ SubnetId: "subnet-6" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I0513 07:35:11.796716 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I0513 07:35:11.796749 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-6" } I0513 07:35:11.796779 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:11.796805 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0513 07:35:11.796842 15421 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I0513 07:35:11.796837 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:11.796914 15421 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0513 07:35:11.796976 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } W0513 07:35:11.796994 15421 api.go:53] PageSize not implemented I0513 07:35:11.797015 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I0513 07:35:11.797043 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:11.797134 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0513 07:35:11.797162 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0513 07:35:11.797194 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0513 07:35:11.797222 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I0513 07:35:11.797243 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:11.797297 15421 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-6"] }] } I0513 07:35:11.797370 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:11.797379 15421 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-6", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0513 07:35:11.797446 15421 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-3"] }] } I0513 07:35:11.797517 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:11.797537 15421 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-3", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }] }] } I0513 07:35:11.797622 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0513 07:35:11.797665 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0513 07:35:11.797695 15421 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I0513 07:35:11.797731 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0513 07:35:11.797759 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0513 07:35:11.797784 15421 tags.go:42] CreateTags { Resources: ["subnet-6"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0513 07:35:11.797813 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I0513 07:35:11.797839 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-5" } I0513 07:35:11.797862 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:11.797958 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0513 07:35:11.797984 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0513 07:35:11.798032 15421 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0513 07:35:11.798081 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:11.798119 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:11.798098 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:11.798137 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:11.798134 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0513 07:35:11.798187 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:11.798295 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0513 07:35:11.798281 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:11.798355 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:11.798245 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:11.798397 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:11.798375 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0513 07:35:11.798344 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-1" } I0513 07:35:11.798545 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:11.798490 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:11.798656 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-1" } I0513 07:35:11.798692 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:11.798778 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0513 07:35:11.802468 15421 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0513 07:35:11.802636 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:11.802724 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:11.802802 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:11.802915 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:11.803399 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:35:11.803674 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:35:11.803877 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0513 07:35:11.803927 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:11.803956 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:11.804009 15421 dns.go:235] Pre-creating DNS records I0513 07:35:11.804029 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:11.809258 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0513 07:35:11.812222 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:11.812291 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:13.092229 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:13.239393 15421 iamrole.go:89] ListRoles: { } I0513 07:35:13.240835 15421 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0513 07:35:13.241150 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.241334 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:13.241368 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:13.241420 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:13.241456 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.241643 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:13.241790 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.241972 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.242033 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:13.244056 15421 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0513 07:35:13.244203 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0513 07:35:13.244306 15421 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0513 07:35:13.244203 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] }] } I0513 07:35:13.244372 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0513 07:35:13.244389 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.244453 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0513 07:35:13.244482 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0513 07:35:13.244511 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:13.244595 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.244689 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.244790 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0513 07:35:13.244932 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:13.244981 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0513 07:35:13.245147 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:13.245210 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.245334 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0513 07:35:13.245466 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:13.245537 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:13.245678 15421 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0513 07:35:13.245801 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.245970 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:13.246057 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0513 07:35:13.246091 15421 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0513 07:35:13.246129 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:13.246250 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:13.246339 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:13.246457 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:13.246551 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:13.246637 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.246744 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0513 07:35:13.246852 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.246961 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0513 07:35:13.247036 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0513 07:35:13.247127 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] }] } I0513 07:35:13.247242 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0513 07:35:13.247292 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.247400 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:13.247431 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.247532 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:13.247561 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:13.247625 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0513 07:35:13.247653 15421 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0513 07:35:13.247679 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0513 07:35:13.247778 15421 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0513 07:35:13.247862 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:13.247869 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:13.247988 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:13.247964 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:13.248012 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0513 07:35:13.248058 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0513 07:35:13.248090 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0513 07:35:13.248120 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0513 07:35:13.248059 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0513 07:35:13.248149 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } W0513 07:35:13.248228 15421 api.go:53] PageSize not implemented I0513 07:35:13.248201 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:13.248279 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:13.248337 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:13.248397 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:13.248455 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:13.248506 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0513 07:35:13.248558 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0513 07:35:13.248677 15421 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0513 07:35:13.248729 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0513 07:35:13.248756 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0513 07:35:13.248779 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:13.248759 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:13.248795 15421 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0513 07:35:13.248794 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:13.248834 15421 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0513 07:35:13.248795 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0513 07:35:13.248826 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:13.248859 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:13.248879 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:13.248879 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0513 07:35:13.248931 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:13.248952 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:13.249003 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:13.249018 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0513 07:35:13.249087 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:13.249110 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0513 07:35:13.253237 15421 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0513 07:35:13.253333 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:13.253459 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:13.253521 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:13.253655 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:13.254050 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:35:13.254259 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:35:13.254460 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0513 07:35:13.257059 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0513 07:35:13.257115 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:13.257143 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0513 07:35:13.257163 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I0513 07:35:13.257185 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0513 07:35:13.257210 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:13.257232 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0513 07:35:13.257254 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0513 07:35:13.257275 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0513 07:35:13.257295 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:13.257320 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0513 07:35:13.257344 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0513 07:35:13.257372 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0513 07:35:13.257399 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0513 07:35:13.257424 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0513 07:35:13.257447 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:35:13.257469 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:35:13.257488 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:13.257513 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0513 07:35:13.257534 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0513 07:35:13.257557 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0513 07:35:13.257581 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:13.257604 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:13.257628 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:13.257650 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:13.257674 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:13.257695 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0513 07:35:13.257718 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0513 07:35:13.257742 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0513 07:35:13.257765 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0513 07:35:13.257790 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0513 07:35:13.257813 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:35:13.257833 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0513 07:35:13.257852 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:13.257875 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:13.257899 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:13.257923 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0513 07:35:13.259481 15421 delete_cluster.go:128] Looking for cloud resources to delete W0513 07:35:13.259534 15421 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0513 07:35:13.259550 15421 keypairs.go:95] DescribeKeyPairs: { } I0513 07:35:13.259584 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.259625 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0513 07:35:13.259671 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.259720 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.259761 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.259802 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.259841 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.259878 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0513 07:35:13.259929 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.259992 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:13.260018 15421 natgateway.go:117] DescribeNatGateways: { } I0513 07:35:13.260056 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0513 07:35:13.260090 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W0513 07:35:13.260131 15421 api.go:53] PageSize not implemented I0513 07:35:13.260146 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:13.260164 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:13.260177 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0513 07:35:13.260204 15421 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0513 07:35:13.260222 15421 targetgroups.go:35] PageSize not implemented I0513 07:35:13.260236 15421 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" ] } I0513 07:35:13.260278 15421 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0513 07:35:13.260308 15421 iamrole.go:89] ListRoles: { } I0513 07:35:13.260349 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:13.260371 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:13.260402 15421 internetgateways.go:101] DescribeInternetGateways: { } I0513 07:35:13.260436 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:13.260483 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3","rtb-2","rtb-1"] } I0513 07:35:13.260518 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0513 07:35:13.260543 15421 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0513 07:35:13.260569 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0513 07:35:13.260591 15421 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0513 07:35:13.261124 15421 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok autoscaling-group:nodes.minimal-ipv6.example.com ok autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok I0513 07:35:13.261170 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0513 07:35:13.261203 15421 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0513 07:35:13.261234 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0513 07:35:13.261273 15421 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } iam-instance-profile:masters.minimal-ipv6.example.com ok internet-gateway:igw-2 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0513 07:35:13.261298 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0513 07:35:13.261333 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } iam-instance-profile:nodes.minimal-ipv6.example.com ok I0513 07:35:13.261304 15421 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I0513 07:35:13.261349 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:13.261462 15421 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0513 07:35:13.261403 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 } ] } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I0513 07:35:13.261352 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } W0513 07:35:13.261521 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions route53-record:Z1AFAKE1ZON3YO/A/api.minimal-ipv6.example.com ok I0513 07:35:13.261536 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0513 07:35:13.261572 15421 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I0513 07:35:13.261620 15421 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0513 07:35:13.261669 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:13.261708 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0513 07:35:13.261736 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0513 07:35:13.261776 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0513 07:35:13.261815 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:13.261858 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0513 07:35:13.262106 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:13.262126 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0513 07:35:13.262156 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0513 07:35:13.262207 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0513 07:35:13.262255 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I0513 07:35:13.262305 15421 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I0513 07:35:13.262392 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0513 07:35:13.262420 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I0513 07:35:13.262441 15421 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I0513 07:35:13.262474 15421 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0513 07:35:13.262487 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0513 07:35:13.262488 15421 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0513 07:35:13.262515 15421 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I0513 07:35:13.262532 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0513 07:35:13.262549 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I0513 07:35:13.262579 15421 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0513 07:35:13.262578 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok I0513 07:35:13.262589 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0513 07:35:13.262621 15421 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I0513 07:35:13.262620 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0513 07:35:13.262691 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0513 07:35:13.262742 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0513 07:35:13.262803 15421 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0513 07:35:13.262863 15421 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (3.01s) === RUN TestLifecycleSharedVPC I0513 07:35:13.263348 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:35:13.263556 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:35:13.263591 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:35:13.263626 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:35:13.263656 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:35:13.263696 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:35:13.263728 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:35:13.263749 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:35:13.263779 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:35:13.263798 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I0513 07:35:13.287447 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:13.289955 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:13.290102 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:14.593732 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:14.732821 15421 iamrole.go:89] ListRoles: { } I0513 07:35:14.733592 15421 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0513 07:35:14.733722 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:14.734097 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0513 07:35:14.734098 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:14.734199 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0513 07:35:14.734305 15421 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0513 07:35:14.734510 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:14.734682 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:14.734808 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:14.734861 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:14.734967 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I0513 07:35:14.735041 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0513 07:35:14.735002 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:14.735158 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:14.737153 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:35:14.737289 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0513 07:35:14.737334 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0513 07:35:14.741401 15421 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0513 07:35:14.741541 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0513 07:35:14.741677 15421 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0513 07:35:14.741807 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0513 07:35:14.741801 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] }] } I0513 07:35:14.741900 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0513 07:35:14.742025 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0513 07:35:14.742009 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0513 07:35:14.742072 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0513 07:35:14.742058 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:14.742154 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0513 07:35:14.742239 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0513 07:35:14.742238 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0513 07:35:14.742397 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0513 07:35:14.742481 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:14.742519 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:14.742549 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:35:14.742633 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0513 07:35:14.742691 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:14.742721 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:14.742763 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:14.742796 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:14.742828 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:14.742858 15421 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0513 07:35:14.743365 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0513 07:35:14.746018 15421 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0513 07:35:14.746208 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:14.746306 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:14.746359 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:14.746500 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0513 07:35:14.746571 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:14.746686 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:14.746762 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0513 07:35:14.746912 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:14.747021 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0513 07:35:14.747142 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" }] }] } I0513 07:35:14.747330 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0513 07:35:14.747487 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:14.747598 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" }] }] } I0513 07:35:14.747735 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0513 07:35:14.747862 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0513 07:35:14.747997 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0513 07:35:14.748107 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0513 07:35:14.748209 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0513 07:35:14.748307 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" }] }] } I0513 07:35:14.748401 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0513 07:35:14.748496 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0513 07:35:14.748620 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0513 07:35:14.748715 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0513 07:35:14.748752 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0513 07:35:14.748781 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" }] }] } I0513 07:35:14.748895 15421 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0513 07:35:14.749074 15421 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0513 07:35:14.749274 15421 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0513 07:35:14.749323 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:14.749353 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:14.749408 15421 dns.go:235] Pre-creating DNS records I0513 07:35:14.749433 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:14.754040 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:14.756559 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:14.756621 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:16.148895 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:16.292848 15421 iamrole.go:89] ListRoles: { } I0513 07:35:16.293643 15421 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0513 07:35:16.294026 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:16.294136 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:16.294206 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:16.296617 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:35:16.296724 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0513 07:35:16.296756 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0513 07:35:16.296825 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:16.299556 15421 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0513 07:35:16.299966 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:35:16.300128 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:16.300800 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0513 07:35:16.300925 15421 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0513 07:35:16.300885 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] }] } I0513 07:35:16.301122 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0513 07:35:16.301282 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:16.301343 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0513 07:35:16.301517 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:16.301579 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:16.305805 15421 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0513 07:35:16.305912 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:16.306046 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:16.306192 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:16.306313 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:16.306409 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:16.306640 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:16.306756 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:16.307237 15421 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0513 07:35:16.307429 15421 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0513 07:35:16.307572 15421 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0513 07:35:16.309555 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0513 07:35:16.309602 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0513 07:35:16.309626 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:16.309649 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0513 07:35:16.309667 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0513 07:35:16.309689 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0513 07:35:16.309711 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0513 07:35:16.309738 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0513 07:35:16.309761 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:35:16.309780 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:35:16.309797 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:16.309817 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0513 07:35:16.309836 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:16.309857 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:16.309878 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:16.309899 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:16.309917 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:35:16.309934 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0513 07:35:16.309951 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:16.309976 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:16.309998 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0513 07:35:16.310983 15421 delete_cluster.go:128] Looking for cloud resources to delete W0513 07:35:16.311032 15421 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0513 07:35:16.311047 15421 keypairs.go:95] DescribeKeyPairs: { } I0513 07:35:16.311078 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:16.311115 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0513 07:35:16.311152 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:16.311200 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:16.311229 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:16.311256 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:16.311284 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:16.311309 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0513 07:35:16.311340 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:16.311376 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0513 07:35:16.311400 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W0513 07:35:16.311432 15421 api.go:53] PageSize not implemented I0513 07:35:16.311448 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:16.311469 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:16.311484 15421 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0513 07:35:16.311501 15421 targetgroups.go:35] PageSize not implemented I0513 07:35:16.311515 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0513 07:35:16.311552 15421 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0513 07:35:16.311579 15421 iamrole.go:89] ListRoles: { } I0513 07:35:16.311614 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:16.311637 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:16.311669 15421 internetgateways.go:101] DescribeInternetGateways: { } I0513 07:35:16.311698 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:16.311717 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:nodes.sharedvpc.example.com ok I0513 07:35:16.312018 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I0513 07:35:16.312068 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } I0513 07:35:16.312096 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } W0513 07:35:16.312163 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:16.312178 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } I0513 07:35:16.312178 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } security-group:sg-2 ok iam-instance-profile:nodes.sharedvpc.example.com ok autoscaling-config:lt-1 ok I0513 07:35:16.312209 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0513 07:35:16.312223 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0513 07:35:16.312264 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } iam-instance-profile:masters.sharedvpc.example.com ok I0513 07:35:16.312254 15421 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0513 07:35:16.312296 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:16.312175 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.sharedvpc.example.com. ok I0513 07:35:16.312328 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0513 07:35:16.312463 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:16.312478 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0513 07:35:16.312499 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok I0513 07:35:16.312563 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I0513 07:35:16.312572 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0513 07:35:16.312600 15421 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0513 07:35:16.312632 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0513 07:35:16.312658 15421 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I0513 07:35:16.312682 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I0513 07:35:16.312735 15421 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I0513 07:35:16.312747 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0513 07:35:16.312769 15421 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I0513 07:35:16.312827 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (3.05s) === RUN TestLifecycleComplex I0513 07:35:16.313325 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:35:16.313551 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:35:16.313586 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:35:16.313621 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:35:16.313649 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:35:16.313688 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:35:16.313718 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:35:16.313739 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:35:16.313766 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:35:16.313787 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I0513 07:35:16.341430 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:35:16.344875 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:16.344946 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:17.624811 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:17.786765 15421 iamrole.go:89] ListRoles: { } I0513 07:35:17.788116 15421 executor.go:111] Tasks: 0 done / 135 total; 51 can run W0513 07:35:17.788483 15421 api.go:53] PageSize not implemented I0513 07:35:17.788561 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:17.788676 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0513 07:35:17.788779 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I0513 07:35:17.788754 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:17.788929 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:17.789177 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0513 07:35:17.789237 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I0513 07:35:17.788977 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:17.791029 15421 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0513 07:35:17.791195 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:17.791269 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0513 07:35:17.791378 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0513 07:35:17.791480 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0513 07:35:17.791546 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:17.791575 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:17.791743 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:17.791934 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0513 07:35:17.792036 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:17.792154 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:17.792364 15421 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0513 07:35:17.792554 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0513 07:35:17.792618 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0513 07:35:17.792664 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:17.792751 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:17.793979 15421 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0513 07:35:17.794109 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0513 07:35:17.794247 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0513 07:35:17.794939 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:17.795045 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0513 07:35:17.795055 15421 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I0513 07:35:17.795032 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0513 07:35:17.795136 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:17.795226 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0513 07:35:17.795253 15421 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0513 07:35:17.795302 15421 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0513 07:35:17.795290 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:17.795264 15421 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0513 07:35:17.795364 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0513 07:35:17.795392 15421 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0513 07:35:17.795414 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0513 07:35:17.795446 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0513 07:35:17.795447 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0513 07:35:17.795472 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0513 07:35:17.795473 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:17.795559 15421 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0513 07:35:17.795635 15421 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0513 07:35:17.795654 15421 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I0513 07:35:17.795741 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:17.795809 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:17.795900 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0513 07:35:17.796002 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api-elb.complex.example.com" } ] }], VpcId: "vpc-1" } I0513 07:35:17.796085 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:17.796186 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:17.796274 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:17.796259 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Public" } ] }], VpcId: "vpc-1" } I0513 07:35:17.796369 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:17.796413 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:17.796417 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0513 07:35:17.796442 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0513 07:35:17.796530 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:17.796568 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:17.796613 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:17.796645 15421 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I0513 07:35:17.796673 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" } ] }], VpcId: "vpc-1" } I0513 07:35:17.796743 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:17.796771 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:17.796797 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:17.796836 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:17.796864 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0513 07:35:17.796951 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0513 07:35:17.796791 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0513 07:35:17.797003 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0513 07:35:17.797069 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:17.797112 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0513 07:35:17.797150 15421 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" } ] } I0513 07:35:17.797274 15421 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0513 07:35:17.797305 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:17.797339 15421 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] } I0513 07:35:17.797459 15421 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0513 07:35:17.797587 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0513 07:35:17.797734 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:17.797878 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0513 07:35:17.797919 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0513 07:35:17.798009 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I0513 07:35:17.798111 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0513 07:35:17.798289 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" } ] }] } I0513 07:35:17.798462 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0513 07:35:17.798659 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" } ] }] } I0513 07:35:17.798802 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:17.798867 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:17.798931 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:17.798977 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:17.799048 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0513 07:35:17.799106 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0513 07:35:17.799106 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0513 07:35:17.799149 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:17.799224 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0513 07:35:17.799362 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I0513 07:35:17.799439 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I0513 07:35:17.799512 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I0513 07:35:17.799589 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0513 07:35:17.799656 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0513 07:35:17.799759 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0513 07:35:17.799867 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0513 07:35:17.799972 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-2", TransitGatewayId: "tgw-0123456" } I0513 07:35:17.800016 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0513 07:35:17.800087 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0513 07:35:17.800190 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" } ] }] } I0513 07:35:17.800290 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0513 07:35:17.800358 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" } ] }] } I0513 07:35:17.800458 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0513 07:35:17.800560 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" } ] }] } I0513 07:35:17.800666 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-2", TransitGatewayId: "tgw-123456" } I0513 07:35:17.800704 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I0513 07:35:17.800771 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:17.800867 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0513 07:35:17.800925 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0513 07:35:17.800982 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:17.801014 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0513 07:35:17.801107 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0513 07:35:17.801221 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0513 07:35:17.801293 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0513 07:35:17.801437 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0513 07:35:17.801631 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0513 07:35:17.801733 15421 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0513 07:35:17.801843 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:17.801948 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:17.801895 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:17.802120 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0513 07:35:17.802194 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0513 07:35:17.802101 15421 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-1" }], Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ], Type: "network" } I0513 07:35:17.802267 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:17.802351 15421 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0513 07:35:17.802439 15421 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0513 07:35:17.802489 15421 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0513 07:35:17.802544 15421 api.go:53] PageSize not implemented I0513 07:35:17.802587 15421 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0513 07:35:17.802638 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:17.802645 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:17.802695 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:17.802712 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:17.802717 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:17.802825 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:17.802801 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:17.802854 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:17.802869 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:17.802882 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:17.807223 15421 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0513 07:35:17.807361 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:17.807433 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:17.807582 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:17.807683 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:17.808075 15421 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0513 07:35:17.808245 15421 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0513 07:35:17.808446 15421 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0513 07:35:17.808489 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:17.808558 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:17.808618 15421 dns.go:235] Pre-creating DNS records I0513 07:35:17.808642 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:17.814780 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:35:17.818228 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:17.818298 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:19.150402 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:19.306704 15421 iamrole.go:89] ListRoles: { } I0513 07:35:19.308225 15421 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0513 07:35:19.308721 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0513 07:35:19.308773 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W0513 07:35:19.308888 15421 api.go:53] PageSize not implemented I0513 07:35:19.308976 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:19.309153 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0513 07:35:19.309253 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:19.309378 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:19.309407 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:19.309461 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:19.309499 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0513 07:35:19.309595 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:19.309728 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:19.309841 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0513 07:35:19.310526 15421 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0513 07:35:19.310644 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0513 07:35:19.310669 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0513 07:35:19.310677 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0513 07:35:19.310745 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:19.310777 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0513 07:35:19.310845 15421 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0513 07:35:19.310806 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:19.310901 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0513 07:35:19.310906 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:19.310980 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:19.311020 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0513 07:35:19.311034 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:19.311064 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:19.311114 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:19.311211 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:19.311280 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0513 07:35:19.311398 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:19.311430 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0513 07:35:19.311546 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:19.311594 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:19.311692 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:19.311761 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:19.311880 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:19.311991 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:19.312021 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:19.312156 15421 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0513 07:35:19.312287 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:19.312491 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:19.312599 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:19.312720 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:19.312872 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:19.312993 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:19.313057 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:19.313197 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:19.313354 15421 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0513 07:35:19.313410 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:19.313445 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:19.313512 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:19.313526 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:19.313560 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:19.313587 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0513 07:35:19.313616 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:19.313641 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:19.313663 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0513 07:35:19.313733 15421 api.go:53] PageSize not implemented I0513 07:35:19.313774 15421 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0513 07:35:19.313813 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0513 07:35:19.313833 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:19.313873 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0513 07:35:19.313851 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:19.313886 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:19.313933 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:19.313908 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:19.313972 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:19.314019 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:19.314035 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:19.314131 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:19.314153 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:19.314227 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:19.314247 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:19.318261 15421 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0513 07:35:19.318352 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:19.318480 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:19.318560 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:19.318695 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:19.319116 15421 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0513 07:35:19.319304 15421 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0513 07:35:19.319448 15421 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I0513 07:35:19.323946 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:19.329990 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:19.340731 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:35:19.344724 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:19.344793 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:20.667726 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:20.820561 15421 iamrole.go:89] ListRoles: { } I0513 07:35:20.824957 15421 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0513 07:35:20.825845 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:20.826017 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0513 07:35:20.826465 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0513 07:35:20.826809 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0513 07:35:20.827098 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:20.827185 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:20.827209 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } W0513 07:35:20.827241 15421 api.go:53] PageSize not implemented I0513 07:35:20.827250 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:20.827334 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:20.827466 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:20.828139 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:20.828192 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0513 07:35:20.829993 15421 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0513 07:35:20.830123 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:20.830166 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0513 07:35:20.830239 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:20.830274 15421 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0513 07:35:20.830220 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0513 07:35:20.830308 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0513 07:35:20.830273 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0513 07:35:20.830338 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0513 07:35:20.830368 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0513 07:35:20.830487 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:20.830492 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:20.830522 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:20.830528 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0513 07:35:20.830565 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:20.830635 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:20.830693 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0513 07:35:20.830802 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:20.830842 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0513 07:35:20.830948 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:20.831001 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I0513 07:35:20.831155 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:20.831189 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:20.831303 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:20.831379 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:20.831447 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:20.831578 15421 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0513 07:35:20.831711 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:20.831800 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:20.832031 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:20.832142 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:20.832208 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:20.832316 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:20.832589 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:20.832655 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:20.832783 15421 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0513 07:35:20.832837 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:20.832862 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:20.832930 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:20.832946 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:20.832974 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:20.832997 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0513 07:35:20.833031 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:20.833056 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:20.833078 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0513 07:35:20.833207 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I0513 07:35:20.833233 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0513 07:35:20.833253 15421 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I0513 07:35:20.833276 15421 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I0513 07:35:20.833299 15421 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0513 07:35:20.833371 15421 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0513 07:35:20.833419 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:20.833443 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W0513 07:35:20.833471 15421 api.go:53] PageSize not implemented I0513 07:35:20.833518 15421 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0513 07:35:20.833572 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:20.833605 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:20.833573 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:20.833631 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:20.833619 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:20.833665 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:20.833643 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:20.833751 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:20.833791 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:20.833807 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:20.833900 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:20.833924 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:20.834006 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:20.834025 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:20.838228 15421 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0513 07:35:20.838320 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:20.838444 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:20.838509 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:20.838654 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:20.839249 15421 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0513 07:35:20.839432 15421 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0513 07:35:20.839657 15421 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0513 07:35:20.839701 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:20.839733 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:20.839792 15421 dns.go:235] Pre-creating DNS records I0513 07:35:20.846003 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:35:20.849548 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:20.849660 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:22.137604 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:22.270082 15421 iamrole.go:89] ListRoles: { } I0513 07:35:22.271497 15421 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0513 07:35:22.273618 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0513 07:35:22.274305 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:22.274999 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0513 07:35:22.275869 15421 api.go:53] PageSize not implemented I0513 07:35:22.275646 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0513 07:35:22.276015 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0513 07:35:22.276410 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0513 07:35:22.276569 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:22.277490 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:22.277546 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:22.277561 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:22.277586 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:22.277617 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0513 07:35:22.279195 15421 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0513 07:35:22.279317 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0513 07:35:22.279275 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I0513 07:35:22.279329 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0513 07:35:22.279377 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:22.279440 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:22.279413 15421 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0513 07:35:22.279484 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0513 07:35:22.279480 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:22.279571 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:22.279604 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0513 07:35:22.279637 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0513 07:35:22.279620 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:22.279725 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:22.279769 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:22.279831 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:22.279850 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:22.279864 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:22.279898 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:22.279955 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0513 07:35:22.280024 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:22.280050 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:22.280084 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0513 07:35:22.280149 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:22.280215 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0513 07:35:22.280338 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:22.280815 15421 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0513 07:35:22.280906 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:22.281015 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:22.281158 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:22.281204 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:22.281396 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:22.281544 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:22.282044 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:22.282145 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:22.282314 15421 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0513 07:35:22.282385 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:22.282402 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:22.282463 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:22.282477 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:22.282507 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:22.282530 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0513 07:35:22.282561 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:22.282584 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:22.282606 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0513 07:35:22.282705 15421 api.go:53] PageSize not implemented I0513 07:35:22.282762 15421 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0513 07:35:22.282818 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:22.282865 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:22.282873 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:22.282883 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:22.282931 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:22.282957 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:22.282980 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:22.283030 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:22.282987 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:22.283096 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:22.283145 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:22.283164 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:22.283245 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:22.283278 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:22.287157 15421 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0513 07:35:22.287245 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:22.287372 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:22.287421 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:22.287551 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:22.287972 15421 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0513 07:35:22.288165 15421 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0513 07:35:22.288357 15421 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I0513 07:35:22.291011 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:22.293833 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:22.303377 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:35:22.306629 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:22.306691 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:23.636899 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:23.790464 15421 iamrole.go:89] ListRoles: { } I0513 07:35:23.791960 15421 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0513 07:35:23.792140 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0513 07:35:23.792381 15421 api.go:53] PageSize not implemented I0513 07:35:23.792409 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0513 07:35:23.792537 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:23.792751 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:23.792915 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0513 07:35:23.793053 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:23.793057 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:23.793192 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:23.793232 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:23.793305 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0513 07:35:23.793389 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:23.793422 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0513 07:35:23.793482 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0513 07:35:23.794151 15421 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0513 07:35:23.794232 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0513 07:35:23.794304 15421 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0513 07:35:23.794287 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0513 07:35:23.794341 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:23.794398 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:23.794450 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0513 07:35:23.794475 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0513 07:35:23.794460 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:23.794550 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:23.794539 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0513 07:35:23.794601 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:23.794626 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0513 07:35:23.794617 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:23.794700 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:23.794809 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:23.794911 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:23.794941 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:23.795012 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:23.795108 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:23.795173 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:23.795279 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0513 07:35:23.795393 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:23.795428 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:23.795520 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0513 07:35:23.795620 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:23.795851 15421 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0513 07:35:23.795930 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:23.796017 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:23.796126 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:23.796342 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:23.796444 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:23.796601 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:23.796663 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:23.796721 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:23.796923 15421 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0513 07:35:23.796976 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:23.796997 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:23.797072 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:23.797088 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:23.797132 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:23.797158 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0513 07:35:23.797188 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:23.797214 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:23.797238 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0513 07:35:23.797305 15421 api.go:53] PageSize not implemented I0513 07:35:23.797344 15421 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0513 07:35:23.797382 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:23.797418 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:23.797420 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:23.797463 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:23.797430 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:23.797483 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:23.797506 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:23.797509 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:23.797572 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:23.797589 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:23.797731 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:23.797765 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:23.797826 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:23.797840 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:23.802004 15421 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0513 07:35:23.802103 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:23.802230 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:23.802281 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:23.802414 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:23.802805 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:23.802859 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:23.803014 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:35:23.803207 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:35:23.803411 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0513 07:35:23.803455 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:23.803486 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:23.803544 15421 dns.go:235] Pre-creating DNS records I0513 07:35:23.809637 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:35:23.813033 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:23.813102 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:25.116856 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:25.269715 15421 iamrole.go:89] ListRoles: { } I0513 07:35:25.271275 15421 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0513 07:35:25.271463 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0513 07:35:25.271594 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0513 07:35:25.271749 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:25.271798 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:25.272050 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:25.272157 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0513 07:35:25.272243 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:25.272339 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0513 07:35:25.272425 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:25.272497 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:25.272512 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } W0513 07:35:25.272597 15421 api.go:53] PageSize not implemented I0513 07:35:25.272623 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0513 07:35:25.274885 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:25.278184 15421 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0513 07:35:25.278334 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0513 07:35:25.278361 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:25.278471 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0513 07:35:25.278569 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:25.278706 15421 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0513 07:35:25.278620 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:25.278704 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:25.279285 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0513 07:35:25.279367 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:25.279361 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:25.279400 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0513 07:35:25.279453 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0513 07:35:25.279422 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0513 07:35:25.279607 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:25.279663 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:25.279782 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:25.279879 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:25.280050 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:25.280135 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:25.280215 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0513 07:35:25.280351 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0513 07:35:25.280493 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:25.280621 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:25.280670 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:25.280801 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:25.280895 15421 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0513 07:35:25.280981 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:25.281094 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:25.281318 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:25.281455 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:25.281639 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:25.281933 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:25.282007 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:25.282117 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:25.282236 15421 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0513 07:35:25.282299 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:25.282359 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:25.282372 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:25.282315 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:25.282402 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:25.282472 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0513 07:35:25.282510 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:25.282535 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:25.282562 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0513 07:35:25.282631 15421 api.go:53] PageSize not implemented I0513 07:35:25.282673 15421 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0513 07:35:25.282712 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0513 07:35:25.282731 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0513 07:35:25.282757 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:25.282774 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:25.282806 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:25.282855 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:25.282769 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:25.282982 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:25.283009 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:25.283099 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:25.283168 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:25.283191 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:25.283265 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:25.283290 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:25.287791 15421 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0513 07:35:25.287880 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:25.288006 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:25.288057 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:25.288166 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:25.288771 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:35:25.288951 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:35:25.289092 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I0513 07:35:25.292847 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:25.295776 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:25.295844 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:25.303567 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:35:25.306961 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:25.307030 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:25.307069 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:26.682037 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:26.788038 15421 iamrole.go:89] ListRoles: { } I0513 07:35:26.788816 15421 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0513 07:35:26.789101 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0513 07:35:26.789410 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0513 07:35:26.789506 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0513 07:35:26.789574 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:26.789711 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } W0513 07:35:26.789799 15421 api.go:53] PageSize not implemented I0513 07:35:26.790248 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:26.790367 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:26.790828 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0513 07:35:26.790908 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0513 07:35:26.791149 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:26.791217 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:26.791239 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:26.791277 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:26.791921 15421 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0513 07:35:26.792030 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0513 07:35:26.791985 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0513 07:35:26.792033 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0513 07:35:26.792110 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:26.792134 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0513 07:35:26.792086 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:26.792178 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0513 07:35:26.792213 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:26.792232 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0513 07:35:26.792262 15421 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0513 07:35:26.792231 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:26.792301 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:26.792381 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0513 07:35:26.792459 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:26.792484 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:26.792555 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0513 07:35:26.792642 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:26.792684 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0513 07:35:26.792781 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:26.792802 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:26.792870 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:26.792891 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:26.792944 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:26.792989 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:26.793034 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:26.793149 15421 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0513 07:35:26.793238 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:26.793341 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:26.793416 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:26.793447 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:26.793646 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:26.793739 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:26.793913 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:26.794001 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:26.794079 15421 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0513 07:35:26.794122 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:26.794165 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:26.794228 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:26.794240 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:26.794270 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:26.794292 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0513 07:35:26.794317 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:26.794336 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:26.794355 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0513 07:35:26.794413 15421 api.go:53] PageSize not implemented I0513 07:35:26.794449 15421 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0513 07:35:26.794484 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:26.794512 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:26.794516 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:26.794552 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:26.794523 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:26.794571 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:26.794589 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:26.794595 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:26.794637 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:26.794650 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:26.794724 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:26.794745 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:26.794795 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:26.794813 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:26.797903 15421 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0513 07:35:26.797991 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:26.798091 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:26.798152 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:26.800882 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:26.801366 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:35:26.801747 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:35:26.801985 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0513 07:35:26.802033 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:26.802075 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:26.802180 15421 dns.go:235] Pre-creating DNS records I0513 07:35:26.808426 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:35:26.811518 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:26.811621 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:26.811675 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:28.105700 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:28.255598 15421 iamrole.go:89] ListRoles: { } I0513 07:35:28.256761 15421 executor.go:111] Tasks: 0 done / 136 total; 52 can run W0513 07:35:28.257199 15421 api.go:53] PageSize not implemented I0513 07:35:28.257240 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0513 07:35:28.257368 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:28.257495 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:28.257587 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0513 07:35:28.257657 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0513 07:35:28.257829 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:28.257918 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0513 07:35:28.258015 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:28.258104 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:28.258126 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:28.258166 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:28.258236 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0513 07:35:28.258457 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:28.261107 15421 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0513 07:35:28.261335 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0513 07:35:28.261563 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0513 07:35:28.261725 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:28.261818 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:28.262061 15421 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0513 07:35:28.261996 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:28.261938 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0513 07:35:28.262129 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:28.262139 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:28.262156 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0513 07:35:28.262161 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:28.262177 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0513 07:35:28.262208 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0513 07:35:28.262363 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:28.262362 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0513 07:35:28.262468 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:28.262513 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0513 07:35:28.262478 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:28.262927 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:28.263003 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:28.263108 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:28.263176 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:28.263277 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:28.263307 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0513 07:35:28.263405 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:28.263521 15421 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0513 07:35:28.264145 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:28.264265 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:28.264391 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:28.264448 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:28.264501 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:28.264688 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:28.264795 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:28.264822 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:28.265000 15421 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0513 07:35:28.265059 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:28.265112 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:28.265082 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:28.265125 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:28.265208 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:28.265267 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0513 07:35:28.265299 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:28.265322 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:28.265344 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0513 07:35:28.265409 15421 api.go:53] PageSize not implemented I0513 07:35:28.265448 15421 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0513 07:35:28.265487 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:28.265529 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:28.265537 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:28.265541 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:28.265587 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:28.265604 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:28.265631 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:28.265691 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:28.265703 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:28.265738 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:28.265739 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:28.265749 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:28.265873 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:28.265895 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:28.269984 15421 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0513 07:35:28.270070 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:28.270192 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:28.270646 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:28.270780 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:28.271350 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:35:28.271504 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:35:28.271636 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I0513 07:35:28.273811 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:28.276519 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:28.276579 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:28.276612 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:28.284134 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:35:28.287244 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:28.287326 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:28.287367 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:28.287397 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:29.597811 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:29.748019 15421 iamrole.go:89] ListRoles: { } I0513 07:35:29.749601 15421 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0513 07:35:29.749859 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0513 07:35:29.749983 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0513 07:35:29.750107 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0513 07:35:29.750177 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0513 07:35:29.750258 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:29.750403 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0513 07:35:29.750507 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0513 07:35:29.750735 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:29.750831 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:29.750853 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:29.750895 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:29.751018 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W0513 07:35:29.751046 15421 api.go:53] PageSize not implemented I0513 07:35:29.751098 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:29.752341 15421 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0513 07:35:29.752453 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0513 07:35:29.752454 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:29.752564 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0513 07:35:29.752638 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:29.752563 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:29.752668 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0513 07:35:29.752663 15421 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0513 07:35:29.752718 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0513 07:35:29.752764 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:29.752788 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0513 07:35:29.752728 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0513 07:35:29.752895 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:29.752947 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:29.753024 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:29.753092 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0513 07:35:29.753202 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:29.753238 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:29.753338 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:29.753363 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:29.753451 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:29.753477 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:29.753576 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:29.753631 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:29.753688 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0513 07:35:29.753800 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:29.753928 15421 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0513 07:35:29.753995 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:29.754134 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:29.754366 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:29.754470 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:29.754561 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:29.754764 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:29.754848 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:29.754959 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:29.755110 15421 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0513 07:35:29.755186 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:29.755234 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:29.755324 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:29.755341 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:29.755376 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:29.755403 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0513 07:35:29.755433 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:29.755458 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:29.755480 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0513 07:35:29.755555 15421 api.go:53] PageSize not implemented I0513 07:35:29.755599 15421 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0513 07:35:29.755641 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:29.755679 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:29.755671 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:29.755709 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:29.755690 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:29.755742 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:29.755791 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:29.755812 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:29.755837 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:29.755912 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:29.755960 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:29.755979 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:29.756065 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:29.756089 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:29.760178 15421 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0513 07:35:29.760273 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:29.760407 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:29.760447 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:29.760589 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:29.761180 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:35:29.761424 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:35:29.761562 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0513 07:35:29.761604 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:29.761638 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:29.761693 15421 dns.go:235] Pre-creating DNS records I0513 07:35:29.767803 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0513 07:35:29.771586 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:29.771655 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:29.771694 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:29.771727 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:31.091060 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:31.218652 15421 iamrole.go:89] ListRoles: { } I0513 07:35:31.219293 15421 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0513 07:35:31.219398 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:31.219411 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0513 07:35:31.219544 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0513 07:35:31.219832 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.219921 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.219966 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:31.219975 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:31.219994 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:31.220193 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.220409 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0513 07:35:31.220497 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0513 07:35:31.221004 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0513 07:35:31.221122 15421 api.go:53] PageSize not implemented I0513 07:35:31.221184 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.222160 15421 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0513 07:35:31.222228 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:31.222273 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0513 07:35:31.222280 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.222333 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0513 07:35:31.222325 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:31.222366 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0513 07:35:31.222367 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0513 07:35:31.222407 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0513 07:35:31.222445 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:31.222460 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0513 07:35:31.222441 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.222509 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0513 07:35:31.222570 15421 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0513 07:35:31.222575 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.222642 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:31.222659 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:31.222687 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:31.222728 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:31.222764 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.222819 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:31.222836 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0513 07:35:31.222901 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:31.222920 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0513 07:35:31.222995 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:31.223032 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:31.223296 15421 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0513 07:35:31.223392 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:31.223436 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:31.223547 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:31.223594 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:31.223674 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.223730 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:31.223772 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0513 07:35:31.223856 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:31.224021 15421 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0513 07:35:31.224065 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0513 07:35:31.224072 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0513 07:35:31.224098 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:31.224126 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:31.224143 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:31.224157 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0513 07:35:31.224174 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0513 07:35:31.224188 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0513 07:35:31.224201 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0513 07:35:31.224242 15421 api.go:53] PageSize not implemented I0513 07:35:31.224261 15421 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0513 07:35:31.224293 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:31.224313 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:31.224323 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:31.224333 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:31.224384 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:31.224407 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:31.224401 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:31.224431 15421 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0513 07:35:31.224413 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:31.224444 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0513 07:35:31.224457 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:31.224519 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:31.224543 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:31.224549 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:31.227429 15421 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0513 07:35:31.227492 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:31.227565 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:31.227651 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:31.227724 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:31.227988 15421 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0513 07:35:31.228137 15421 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0513 07:35:31.228271 15421 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0513 07:35:31.228337 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0513 07:35:31.228359 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:31.228375 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0513 07:35:31.228386 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:31.228399 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0513 07:35:31.228412 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0513 07:35:31.228425 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:31.228440 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0513 07:35:31.228459 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0513 07:35:31.228476 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:35:31.228489 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:35:31.228501 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:31.228516 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0513 07:35:31.228538 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0513 07:35:31.228556 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:31.228570 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:31.228584 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:31.228598 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:31.228612 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:31.228624 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0513 07:35:31.228640 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0513 07:35:31.228656 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:35:31.228671 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0513 07:35:31.228683 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:31.228697 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:31.228712 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:31.228728 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0513 07:35:31.230036 15421 delete_cluster.go:128] Looking for cloud resources to delete W0513 07:35:31.230073 15421 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0513 07:35:31.230083 15421 keypairs.go:95] DescribeKeyPairs: { } I0513 07:35:31.230098 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.230121 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0513 07:35:31.230149 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.230177 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.230205 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.230229 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.230248 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.230266 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0513 07:35:31.230292 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.230322 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0513 07:35:31.230341 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W0513 07:35:31.230367 15421 api.go:53] PageSize not implemented I0513 07:35:31.230375 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:31.230385 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:31.230392 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0513 07:35:31.230410 15421 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0513 07:35:31.230420 15421 targetgroups.go:35] PageSize not implemented I0513 07:35:31.230428 15421 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" ] } I0513 07:35:31.230458 15421 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0513 07:35:31.230473 15421 iamrole.go:89] ListRoles: { } I0513 07:35:31.230495 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:31.230507 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:31.230525 15421 internetgateways.go:101] DescribeInternetGateways: { } I0513 07:35:31.230545 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:31.230564 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0513 07:35:31.230837 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:31.230866 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-group:master-us-test-1a.masters.complex.example.com ok I0513 07:35:31.230894 15421 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5 ok autoscaling-config:lt-1 ok I0513 07:35:31.230933 15421 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok I0513 07:35:31.230973 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0513 07:35:31.231011 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0513 07:35:31.231034 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok autoscaling-group:nodes.complex.example.com ok I0513 07:35:31.231056 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok autoscaling-config:lt-2 ok I0513 07:35:31.231085 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:31.231108 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 } ] } W0513 07:35:31.231286 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:31.231294 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0513 07:35:31.231313 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:31.231339 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 } ] } W0513 07:35:31.231434 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:31.231440 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0513 07:35:31.231459 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0513 07:35:31.231485 15421 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4 ok I0513 07:35:31.231522 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.complex.example.com ok I0513 07:35:31.231638 15421 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0513 07:35:31.231664 15421 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0513 07:35:31.231682 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0513 07:35:31.231706 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0513 07:35:31.231725 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } iam-instance-profile:masters.complex.example.com ok I0513 07:35:31.231757 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0513 07:35:31.231783 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0513 07:35:31.231809 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I0513 07:35:31.231828 15421 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I0513 07:35:31.231835 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0513 07:35:31.231849 15421 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I0513 07:35:31.231876 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I0513 07:35:31.231896 15421 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I0513 07:35:31.231902 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0513 07:35:31.231914 15421 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I0513 07:35:31.231938 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0513 07:35:31.231969 15421 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0513 07:35:31.232002 15421 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (14.92s) === RUN TestLifecycleExternalLB I0513 07:35:31.232380 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:35:31.232518 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:35:31.232537 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:35:31.232558 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:35:31.232575 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:35:31.232597 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:35:31.232617 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:35:31.232629 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:35:31.232646 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:35:31.232659 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I0513 07:35:31.244876 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:31.246445 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:31.246531 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:32.591220 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:32.732241 15421 iamrole.go:89] ListRoles: { } I0513 07:35:32.733660 15421 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0513 07:35:32.733843 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0513 07:35:32.733948 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0513 07:35:32.733977 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } W0513 07:35:32.733984 15421 api.go:53] PageSize not implemented I0513 07:35:32.734050 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:32.734033 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0513 07:35:32.734238 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0513 07:35:32.734273 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0513 07:35:32.734175 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:32.734212 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } W0513 07:35:32.734384 15421 api.go:53] PageSize not implemented I0513 07:35:32.734340 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "masters.externallb.example.com" }] } I0513 07:35:32.734321 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0513 07:35:32.734399 15421 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0513 07:35:32.734457 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0513 07:35:32.734436 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I0513 07:35:32.734502 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0513 07:35:32.734519 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:32.734520 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0513 07:35:32.734570 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:32.734687 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } W0513 07:35:32.734796 15421 api.go:53] PageSize not implemented I0513 07:35:32.734735 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:32.734861 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:32.734897 15421 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0513 07:35:32.734928 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] }] } I0513 07:35:32.735120 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:32.735269 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:32.735322 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:32.735459 15421 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0513 07:35:32.735605 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0513 07:35:32.735642 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0513 07:35:32.735665 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:32.735701 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:32.736251 15421 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0513 07:35:32.736333 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0513 07:35:32.736459 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:32.736528 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:32.736473 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0513 07:35:32.736574 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:32.736591 15421 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0513 07:35:32.736634 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0513 07:35:32.736615 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:32.736786 15421 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0513 07:35:32.736850 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0513 07:35:32.736826 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:32.736930 15421 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0513 07:35:32.736982 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] }] } I0513 07:35:32.737138 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0513 07:35:32.737171 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0513 07:35:32.737172 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:32.737384 15421 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0513 07:35:32.737480 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:32.737522 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I0513 07:35:32.737597 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0513 07:35:32.737698 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0513 07:35:32.737683 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0513 07:35:32.737849 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "masters.externallb.example.com" }] }], VpcId: "vpc-1" } I0513 07:35:32.737947 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:32.737995 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:32.738076 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:32.738118 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:32.738170 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:32.738223 15421 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" } ] } I0513 07:35:32.738457 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0513 07:35:32.740764 15421 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0513 07:35:32.740955 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0513 07:35:32.741123 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0513 07:35:32.741320 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" }] }] } I0513 07:35:32.741494 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0513 07:35:32.741608 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0513 07:35:32.741787 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:32.741894 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:32.742037 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" }] }] } I0513 07:35:32.742177 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:32.742256 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:32.742340 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:32.742411 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" }] }] } I0513 07:35:32.742559 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" }] }] } I0513 07:35:32.742659 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0513 07:35:32.742751 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" }] }] } I0513 07:35:32.742842 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0513 07:35:32.742883 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0513 07:35:32.742971 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:32.743044 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:32.743119 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0513 07:35:32.743267 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0513 07:35:32.743317 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0513 07:35:32.743428 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0513 07:35:32.743534 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0513 07:35:32.743573 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0513 07:35:32.743660 15421 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0513 07:35:32.743882 15421 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0513 07:35:32.744092 15421 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0513 07:35:32.744127 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:32.744160 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:32.744214 15421 dns.go:235] Pre-creating DNS records I0513 07:35:32.744240 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:32.749151 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:32.751715 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:32.751787 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:34.117638 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:34.260693 15421 iamrole.go:89] ListRoles: { } I0513 07:35:34.261746 15421 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0513 07:35:34.261937 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:34.262006 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0513 07:35:34.262120 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } W0513 07:35:34.262151 15421 api.go:53] PageSize not implemented I0513 07:35:34.262153 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0513 07:35:34.262098 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W0513 07:35:34.262269 15421 api.go:53] PageSize not implemented W0513 07:35:34.262317 15421 api.go:53] PageSize not implemented I0513 07:35:34.262270 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.262301 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0513 07:35:34.262388 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0513 07:35:34.262420 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0513 07:35:34.262391 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] }] } I0513 07:35:34.262501 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.262579 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:34.262602 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:34.262638 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:34.262901 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0513 07:35:34.262971 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0513 07:35:34.262992 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0513 07:35:34.263481 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:34.264607 15421 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0513 07:35:34.264803 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0513 07:35:34.264775 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:34.264890 15421 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0513 07:35:34.264868 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0513 07:35:34.265011 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:34.265072 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] }] } I0513 07:35:34.265224 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0513 07:35:34.265389 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:34.265448 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.265566 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:34.265644 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.265792 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:34.269342 15421 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0513 07:35:34.269477 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:34.269607 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:34.269691 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:34.269898 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:34.269973 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:34.270093 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:34.270206 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:34.271182 15421 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0513 07:35:34.271361 15421 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0513 07:35:34.271552 15421 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0513 07:35:34.273998 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0513 07:35:34.274052 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:34.274084 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0513 07:35:34.274106 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:34.274126 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0513 07:35:34.274146 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0513 07:35:34.274172 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:34.274194 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0513 07:35:34.274216 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0513 07:35:34.274243 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0513 07:35:34.274267 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:35:34.274286 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:35:34.274308 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:34.274329 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0513 07:35:34.274348 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:34.274372 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:34.274395 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:34.274417 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:34.274439 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:35:34.274457 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0513 07:35:34.274478 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:34.274500 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:34.274521 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:34.274544 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0513 07:35:34.275602 15421 delete_cluster.go:128] Looking for cloud resources to delete W0513 07:35:34.275657 15421 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0513 07:35:34.275671 15421 keypairs.go:95] DescribeKeyPairs: { } I0513 07:35:34.275701 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.275741 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0513 07:35:34.275784 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.275825 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.275856 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.275894 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.275924 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.275951 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0513 07:35:34.275986 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.276022 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0513 07:35:34.276050 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W0513 07:35:34.276090 15421 api.go:53] PageSize not implemented I0513 07:35:34.276107 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:34.276128 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:34.276144 15421 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0513 07:35:34.276163 15421 targetgroups.go:35] PageSize not implemented I0513 07:35:34.276177 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0513 07:35:34.276218 15421 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0513 07:35:34.276247 15421 iamrole.go:89] ListRoles: { } I0513 07:35:34.276287 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:34.276310 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:34.276342 15421 internetgateways.go:101] DescribeInternetGateways: { } I0513 07:35:34.276376 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:34.276402 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:34.276734 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I0513 07:35:34.276810 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0513 07:35:34.276784 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } I0513 07:35:34.276874 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok W0513 07:35:34.276889 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:34.276912 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:nodes.externallb.example.com ok I0513 07:35:34.276917 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0513 07:35:34.276982 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok I0513 07:35:34.276898 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.externallb.example.com. ok I0513 07:35:34.276960 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0513 07:35:34.277117 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:34.277139 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0513 07:35:34.277173 15421 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0513 07:35:34.277242 15421 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0513 07:35:34.277289 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0513 07:35:34.277340 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0513 07:35:34.277380 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0513 07:35:34.277423 15421 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0513 07:35:34.277550 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I0513 07:35:34.277621 15421 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I0513 07:35:34.277634 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0513 07:35:34.277659 15421 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I0513 07:35:34.277576 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0513 07:35:34.277685 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I0513 07:35:34.277735 15421 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I0513 07:35:34.277745 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0513 07:35:34.277766 15421 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I0513 07:35:34.277820 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0513 07:35:34.277887 15421 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0513 07:35:34.277946 15421 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (3.05s) === RUN TestLifecycleSharedSubnet I0513 07:35:34.278479 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:35:34.278744 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:35:34.278783 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:35:34.278818 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:35:34.278849 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:35:34.278884 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:35:34.278930 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:35:34.278952 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:35:34.278979 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:35:34.279002 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I0513 07:35:34.297623 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:34.300182 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:34.300311 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:35.626256 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:35.773585 15421 iamrole.go:89] ListRoles: { } I0513 07:35:35.774569 15421 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0513 07:35:35.774880 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:35:35.774912 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:35.774972 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0513 07:35:35.775002 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0513 07:35:35.775140 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:35.775340 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:35.775460 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:35.775358 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0513 07:35:35.775518 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedsubnet.example.com" }] } I0513 07:35:35.775607 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:35.775735 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0513 07:35:35.775844 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedsubnet.example.com" }] } I0513 07:35:35.775759 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:35.775996 15421 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0513 07:35:35.776147 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:35.776271 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:35.776773 15421 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0513 07:35:35.776867 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0513 07:35:35.777010 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0513 07:35:35.777108 15421 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0513 07:35:35.777080 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0513 07:35:35.777256 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0513 07:35:35.777276 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }], VpcId: "vpc-12345678" } I0513 07:35:35.777338 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0513 07:35:35.777370 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:35.777420 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:35.777461 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:35:35.777559 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0513 07:35:35.777702 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0513 07:35:35.777886 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedsubnet.example.com" }] }], VpcId: "vpc-12345678" } I0513 07:35:35.777961 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:35.777997 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:35.778031 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:35.778065 15421 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] } I0513 07:35:35.778932 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0513 07:35:35.781559 15421 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0513 07:35:35.781803 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0513 07:35:35.781981 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0513 07:35:35.782100 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0513 07:35:35.782206 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0513 07:35:35.782376 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0513 07:35:35.782491 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0513 07:35:35.782647 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" }] }] } I0513 07:35:35.782803 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0513 07:35:35.782964 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0513 07:35:35.783173 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0513 07:35:35.783336 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:35.783437 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:35.783520 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0513 07:35:35.783673 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0513 07:35:35.783789 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0513 07:35:35.783893 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0513 07:35:35.783998 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:35.784078 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:35.784640 15421 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0513 07:35:35.784877 15421 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0513 07:35:35.785135 15421 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0513 07:35:35.785177 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:35.785224 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:35.785286 15421 dns.go:235] Pre-creating DNS records I0513 07:35:35.785312 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:35.789862 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:35.792570 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:35.792642 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:37.106669 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:37.254361 15421 iamrole.go:89] ListRoles: { } I0513 07:35:37.255451 15421 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0513 07:35:37.255892 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:37.256056 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:37.256520 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:37.256652 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:35:37.256725 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0513 07:35:37.256750 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0513 07:35:37.257230 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:37.258754 15421 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0513 07:35:37.258881 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:35:37.258989 15421 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0513 07:35:37.258984 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0513 07:35:37.259054 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0513 07:35:37.259115 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:37.259162 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0513 07:35:37.259280 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0513 07:35:37.259399 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:37.263203 15421 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0513 07:35:37.263448 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:37.263620 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:37.263832 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:37.263989 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:37.264407 15421 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0513 07:35:37.264607 15421 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0513 07:35:37.264784 15421 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0513 07:35:37.266836 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0513 07:35:37.266890 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0513 07:35:37.266914 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:37.266934 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0513 07:35:37.266954 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0513 07:35:37.266974 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0513 07:35:37.266998 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0513 07:35:37.267034 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0513 07:35:37.267060 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:35:37.267081 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:35:37.267102 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0513 07:35:37.267141 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:37.267167 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:37.267190 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:37.267214 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:35:37.267234 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0513 07:35:37.267253 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:37.267277 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:37.267301 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0513 07:35:37.268345 15421 delete_cluster.go:128] Looking for cloud resources to delete W0513 07:35:37.268401 15421 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0513 07:35:37.268416 15421 keypairs.go:95] DescribeKeyPairs: { } I0513 07:35:37.268447 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:37.268486 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0513 07:35:37.268549 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:37.268601 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:37.268632 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:37.268663 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:37.268694 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:37.268719 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0513 07:35:37.268746 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:37.268781 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0513 07:35:37.268803 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W0513 07:35:37.268841 15421 api.go:53] PageSize not implemented I0513 07:35:37.268861 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:37.268882 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:37.268898 15421 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0513 07:35:37.268916 15421 targetgroups.go:35] PageSize not implemented I0513 07:35:37.268931 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0513 07:35:37.268976 15421 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0513 07:35:37.269008 15421 iamrole.go:89] ListRoles: { } I0513 07:35:37.269044 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:37.269068 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:37.269102 15421 internetgateways.go:101] DescribeInternetGateways: { } I0513 07:35:37.269136 15421 routetable.go:53] DescribeRouteTables: { } autoscaling-config:lt-2 ok autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok I0513 07:35:37.269437 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0513 07:35:37.269488 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } iam-instance-profile:nodes.sharedsubnet.example.com ok autoscaling-group:nodes.sharedsubnet.example.com ok I0513 07:35:37.269483 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:37.269569 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0513 07:35:37.269630 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok I0513 07:35:37.269535 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedsubnet.example.com. ok I0513 07:35:37.269589 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0513 07:35:37.269755 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:37.269788 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-1 ok I0513 07:35:37.269856 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:37.269918 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W0513 07:35:37.270075 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:37.270105 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0513 07:35:37.270162 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0513 07:35:37.270234 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0513 07:35:37.270295 15421 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0513 07:35:37.270397 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I0513 07:35:37.270453 15421 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0513 07:35:37.270474 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0513 07:35:37.270943 15421 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok I0513 07:35:37.270996 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I0513 07:35:37.271042 15421 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0513 07:35:37.271061 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0513 07:35:37.271096 15421 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (2.99s) === RUN TestLifecyclePrivateSharedSubnet I0513 07:35:37.271627 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:35:37.271885 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:35:37.271931 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:35:37.271993 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:35:37.272037 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:35:37.272100 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:35:37.272145 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:35:37.272184 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:35:37.272237 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:35:37.272273 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I0513 07:35:37.294227 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:37.297090 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:37.297241 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:37.297312 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:38.608172 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:38.757784 15421 iamrole.go:89] ListRoles: { } I0513 07:35:38.759013 15421 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0513 07:35:38.759299 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0513 07:35:38.759457 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:35:38.759484 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:38.759561 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0513 07:35:38.759593 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0513 07:35:38.759539 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0513 07:35:38.759647 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" }] } I0513 07:35:38.759637 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:38.759756 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:38.759808 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0513 07:35:38.759881 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0513 07:35:38.759962 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0513 07:35:38.759943 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:38.760031 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:38.760064 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:38.760162 15421 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.760354 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0513 07:35:38.762140 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0513 07:35:38.766709 15421 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0513 07:35:38.766886 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0513 07:35:38.766955 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0513 07:35:38.767050 15421 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0513 07:35:38.767067 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0513 07:35:38.767116 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0513 07:35:38.767154 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:38.767196 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:38.767170 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0513 07:35:38.767187 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0513 07:35:38.767231 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0513 07:35:38.768040 15421 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0513 07:35:38.768131 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0513 07:35:38.768177 15421 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0513 07:35:38.768170 15421 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0513 07:35:38.768195 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0513 07:35:38.768203 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0513 07:35:38.768340 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:35:38.768445 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0513 07:35:38.768704 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0513 07:35:38.768826 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:38.768889 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:38.768854 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0513 07:35:38.768949 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0513 07:35:38.769158 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:35:38.769229 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0513 07:35:38.769324 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0513 07:35:38.769487 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:38.769550 15421 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" }] } I0513 07:35:38.769642 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:38.769677 15421 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" }] } I0513 07:35:38.769742 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0513 07:35:38.769844 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0513 07:35:38.769889 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0513 07:35:38.769917 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:38.770010 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0513 07:35:38.770343 15421 executor.go:111] Tasks: 72 done / 123 total; 31 can run W0513 07:35:38.770972 15421 api.go:53] PageSize not implemented I0513 07:35:38.770515 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I0513 07:35:38.771101 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:38.771130 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:38.771216 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:38.771194 15421 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0513 07:35:38.771249 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:38.771273 15421 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0513 07:35:38.771296 15421 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I0513 07:35:38.771318 15421 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0513 07:35:38.771276 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0513 07:35:38.771491 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" }] }] } I0513 07:35:38.771685 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:38.771774 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:38.771886 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.772070 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0513 07:35:38.772225 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0513 07:35:38.772269 15421 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } W0513 07:35:38.772352 15421 api.go:53] PageSize not implemented I0513 07:35:38.772380 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:38.772259 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.772458 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I0513 07:35:38.772580 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.772686 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.772790 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I0513 07:35:38.772888 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.772986 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.773085 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0513 07:35:38.773157 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.773258 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.773360 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0513 07:35:38.773456 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0513 07:35:38.773530 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0513 07:35:38.773627 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.773730 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.773827 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.773924 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0513 07:35:38.774002 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0513 07:35:38.774101 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I0513 07:35:38.774233 15421 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0513 07:35:38.774270 15421 api.go:53] PageSize not implemented I0513 07:35:38.774307 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:38.774312 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:38.774373 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0513 07:35:38.774403 15421 api.go:53] PageSize not implemented I0513 07:35:38.774465 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:38.774472 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:38.774602 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:38.778869 15421 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0513 07:35:38.779099 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:38.779211 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:38.779296 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:38.779414 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:38.780042 15421 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0513 07:35:38.780267 15421 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0513 07:35:38.780493 15421 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0513 07:35:38.780539 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:38.780571 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:38.780629 15421 dns.go:235] Pre-creating DNS records I0513 07:35:38.780652 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:38.785806 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:38.788722 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:38.788788 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:38.788832 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:40.081405 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:40.231390 15421 iamrole.go:89] ListRoles: { } I0513 07:35:40.232860 15421 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0513 07:35:40.233225 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:35:40.233322 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0513 07:35:40.233354 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0513 07:35:40.233375 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:40.233553 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] }] } I0513 07:35:40.233728 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:40.233843 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0513 07:35:40.235148 15421 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0513 07:35:40.235269 15421 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0513 07:35:40.235314 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0513 07:35:40.235466 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0513 07:35:40.235460 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:40.235584 15421 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0513 07:35:40.235563 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0513 07:35:40.235654 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0513 07:35:40.235546 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0513 07:35:40.235687 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0513 07:35:40.235763 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:40.235831 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0513 07:35:40.235965 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:35:40.236059 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0513 07:35:40.236172 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0513 07:35:40.236212 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0513 07:35:40.236313 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0513 07:35:40.236448 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:40.236703 15421 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0513 07:35:40.236859 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:40.236928 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:40.236945 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } W0513 07:35:40.236974 15421 api.go:53] PageSize not implemented I0513 07:35:40.236979 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0513 07:35:40.237006 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0513 07:35:40.236995 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:40.237037 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0513 07:35:40.236997 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:40.237066 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0513 07:35:40.237154 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:40.237073 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:40.237267 15421 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } W0513 07:35:40.237357 15421 api.go:53] PageSize not implemented I0513 07:35:40.237384 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:40.237541 15421 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0513 07:35:40.237603 15421 api.go:53] PageSize not implemented W0513 07:35:40.237624 15421 api.go:53] PageSize not implemented I0513 07:35:40.237637 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:40.237693 15421 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0513 07:35:40.237683 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:40.237724 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:40.237763 15421 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0513 07:35:40.237781 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:40.237887 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:40.237990 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:40.242019 15421 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0513 07:35:40.242135 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:40.242255 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:40.242310 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:40.242443 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:40.242901 15421 executor.go:111] Tasks: 115 done / 123 total; 2 can run W0513 07:35:40.243008 15421 api.go:53] PageSize not implemented I0513 07:35:40.243036 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:40.243231 15421 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0513 07:35:40.243427 15421 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0513 07:35:40.246024 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0513 07:35:40.246078 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0513 07:35:40.246104 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:40.246125 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0513 07:35:40.246144 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0513 07:35:40.246164 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0513 07:35:40.246193 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0513 07:35:40.246222 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0513 07:35:40.246249 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0513 07:35:40.246274 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:35:40.246295 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:35:40.246313 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0513 07:35:40.246335 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:40.246356 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:40.246378 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:40.246400 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0513 07:35:40.246422 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:40.246445 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:35:40.246466 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0513 07:35:40.246486 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:40.246509 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:40.246530 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0513 07:35:40.247672 15421 delete_cluster.go:128] Looking for cloud resources to delete W0513 07:35:40.247735 15421 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0513 07:35:40.247754 15421 keypairs.go:95] DescribeKeyPairs: { } I0513 07:35:40.247787 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0513 07:35:40.247830 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0513 07:35:40.247878 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0513 07:35:40.247926 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0513 07:35:40.247957 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0513 07:35:40.247987 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0513 07:35:40.248020 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0513 07:35:40.248046 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0513 07:35:40.248074 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0513 07:35:40.248104 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0513 07:35:40.248129 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W0513 07:35:40.248161 15421 api.go:53] PageSize not implemented I0513 07:35:40.248176 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0513 07:35:40.248206 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:40.248226 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:40.248238 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0513 07:35:40.248269 15421 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0513 07:35:40.248288 15421 targetgroups.go:35] PageSize not implemented I0513 07:35:40.248301 15421 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" ] } I0513 07:35:40.248346 15421 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0513 07:35:40.248385 15421 iamrole.go:89] ListRoles: { } I0513 07:35:40.248425 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:40.248447 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:40.248480 15421 internetgateways.go:101] DescribeInternetGateways: { } I0513 07:35:40.248516 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:40.248947 15421 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } load-balancer:api-private-shared-subnet-n2f8ak ok I0513 07:35:40.249020 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0513 07:35:40.249008 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0513 07:35:40.249082 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } iam-instance-profile:nodes.private-shared-subnet.example.com ok I0513 07:35:40.249108 15421 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } autoscaling-group:bastion.private-shared-subnet.example.com ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I0513 07:35:40.249063 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } I0513 07:35:40.249170 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } W0513 07:35:40.249208 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:40.249212 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I0513 07:35:40.249228 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } autoscaling-group:nodes.private-shared-subnet.example.com ok I0513 07:35:40.249059 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-config:lt-1 ok route53-record:Z1AFAKE1ZON3YO/A/api.internal.private-shared-subnet.example.com. ok I0513 07:35:40.249219 15421 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok security-group:sg-4 ok I0513 07:35:40.249281 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:40.249365 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0513 07:35:40.249429 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I0513 07:35:40.249336 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0513 07:35:40.249463 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:40.249479 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0513 07:35:40.249508 15421 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0513 07:35:40.249569 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:40.249609 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0513 07:35:40.249748 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:40.249767 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0513 07:35:40.249801 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-3 ok I0513 07:35:40.249854 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok I0513 07:35:40.249942 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I0513 07:35:40.249980 15421 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0513 07:35:40.249975 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:40.249993 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0513 07:35:40.250027 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I0513 07:35:40.250100 15421 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } W0513 07:35:40.250111 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-role:nodes.private-shared-subnet.example.com ok I0513 07:35:40.250123 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0513 07:35:40.250126 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I0513 07:35:40.250158 15421 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0513 07:35:40.250168 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0513 07:35:40.250187 15421 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok I0513 07:35:40.250209 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I0513 07:35:40.250237 15421 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0513 07:35:40.250253 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0513 07:35:40.250272 15421 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (2.98s) === RUN TestLifecyclePrivateSharedIP I0513 07:35:40.250776 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:35:40.251006 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:35:40.251042 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:35:40.251079 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:35:40.251111 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:35:40.251150 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:35:40.251183 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:35:40.251203 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:35:40.251230 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:35:40.251251 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I0513 07:35:40.273047 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:40.279727 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:40.279804 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:40.279846 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:41.605932 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:41.749105 15421 iamrole.go:89] ListRoles: { } I0513 07:35:41.750413 15421 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0513 07:35:41.750740 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:41.750834 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:41.750945 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:35:41.750958 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I0513 07:35:41.751049 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0513 07:35:41.751078 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0513 07:35:41.751057 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" }] } I0513 07:35:41.751139 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:41.751307 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:41.751457 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0513 07:35:41.751522 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0513 07:35:41.751668 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:41.751829 15421 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0513 07:35:41.752008 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0513 07:35:41.752104 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:41.752136 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0513 07:35:41.752277 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:41.752388 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:41.753460 15421 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0513 07:35:41.753612 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:41.753750 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0513 07:35:41.753760 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0513 07:35:41.753834 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0513 07:35:41.753904 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0513 07:35:41.753792 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0513 07:35:41.753933 15421 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0513 07:35:41.753888 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:35:41.753975 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0513 07:35:41.753957 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0513 07:35:41.754060 15421 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0513 07:35:41.754162 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0513 07:35:41.754013 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0513 07:35:41.755283 15421 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0513 07:35:41.755450 15421 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0513 07:35:41.755332 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0513 07:35:41.755463 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0513 07:35:41.755666 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:41.755899 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0513 07:35:41.755985 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0513 07:35:41.756086 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:41.756207 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0513 07:35:41.756376 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:41.756522 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0513 07:35:41.756660 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0513 07:35:41.756804 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:41.756934 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:41.757024 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0513 07:35:41.757098 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:41.757152 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0513 07:35:41.757372 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I0513 07:35:41.757503 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0513 07:35:41.757689 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:41.757676 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-12345678" } I0513 07:35:41.757849 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0513 07:35:41.758192 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0513 07:35:41.758315 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:41.758356 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:41.758413 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:41.758564 15421 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0513 07:35:41.759192 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:41.759243 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:41.759291 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0513 07:35:41.759330 15421 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" } ] } I0513 07:35:41.759392 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0513 07:35:41.759426 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:41.759456 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0513 07:35:41.760489 15421 executor.go:111] Tasks: 74 done / 132 total; 36 can run W0513 07:35:41.760658 15421 api.go:53] PageSize not implemented I0513 07:35:41.760822 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:41.760769 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0513 07:35:41.760940 15421 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] } I0513 07:35:41.761011 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:41.761043 15421 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0513 07:35:41.761019 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0513 07:35:41.761112 15421 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0513 07:35:41.761164 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0513 07:35:41.761327 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:41.761402 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:41.761352 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0513 07:35:41.761492 15421 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }], Type: "network" } I0513 07:35:41.761538 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:41.761662 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0513 07:35:41.761771 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0513 07:35:41.762007 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" }] }] } I0513 07:35:41.762142 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:41.762219 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0513 07:35:41.762323 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0513 07:35:41.762511 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0513 07:35:41.762640 15421 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0513 07:35:41.762720 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0513 07:35:41.762845 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:41.762909 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0513 07:35:41.763099 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:41.763154 15421 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } W0513 07:35:41.763234 15421 api.go:53] PageSize not implemented I0513 07:35:41.763261 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:41.763228 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0513 07:35:41.763387 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0513 07:35:41.763498 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0513 07:35:41.763537 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0513 07:35:41.763568 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0513 07:35:41.763665 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0513 07:35:41.763764 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0513 07:35:41.763915 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0513 07:35:41.764026 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:41.764062 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0513 07:35:41.764163 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:41.764239 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" }] }] } I0513 07:35:41.764331 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0513 07:35:41.764428 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" }] }] } I0513 07:35:41.764523 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" }] }] } I0513 07:35:41.764622 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0513 07:35:41.764662 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:41.764719 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0513 07:35:41.764791 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" }] }] } I0513 07:35:41.764888 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:41.764927 15421 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I0513 07:35:41.764964 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:41.765042 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0513 07:35:41.765071 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0513 07:35:41.765128 15421 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0513 07:35:41.765179 15421 api.go:53] PageSize not implemented I0513 07:35:41.765232 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:41.765291 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:41.765260 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0513 07:35:41.765389 15421 api.go:53] PageSize not implemented I0513 07:35:41.765373 15421 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:41.765384 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:41.765499 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:41.765503 15421 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0513 07:35:41.765450 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:41.765585 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0513 07:35:41.765618 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:41.765571 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:41.765648 15421 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0513 07:35:41.770519 15421 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0513 07:35:41.771066 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:41.771181 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0513 07:35:41.771248 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:41.771384 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:41.771468 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:41.771585 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:41.772178 15421 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0513 07:35:41.772487 15421 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0513 07:35:41.772697 15421 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0513 07:35:41.772735 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:41.772766 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:41.772823 15421 dns.go:235] Pre-creating DNS records I0513 07:35:41.772846 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:41.777835 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:41.780589 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:41.780654 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:41.780698 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:43.057841 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:43.200540 15421 iamrole.go:89] ListRoles: { } I0513 07:35:43.201726 15421 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0513 07:35:43.203305 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:43.203556 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:43.204698 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.208426 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] }] } I0513 07:35:43.208667 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0513 07:35:43.208742 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0513 07:35:43.208774 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0513 07:35:43.209506 15421 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0513 07:35:43.209640 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.209791 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0513 07:35:43.209774 15421 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0513 07:35:43.209850 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0513 07:35:43.209782 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0513 07:35:43.209889 15421 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0513 07:35:43.209829 15421 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0513 07:35:43.209949 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] }] } I0513 07:35:43.210096 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:43.210131 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:43.210173 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0513 07:35:43.210241 15421 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0513 07:35:43.210289 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:43.210327 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.210445 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0513 07:35:43.210474 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0513 07:35:43.210574 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:43.210613 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.210706 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0513 07:35:43.210788 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0513 07:35:43.210883 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0513 07:35:43.211170 15421 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0513 07:35:43.211248 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:43.211395 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0513 07:35:43.211504 15421 api.go:53] PageSize not implemented I0513 07:35:43.211459 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:43.211567 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:43.211559 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:43.211546 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:43.211672 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:43.211721 15421 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0513 07:35:43.211592 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0513 07:35:43.211762 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:43.211850 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0513 07:35:43.211943 15421 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0513 07:35:43.211979 15421 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0513 07:35:43.211958 15421 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0513 07:35:43.212013 15421 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0513 07:35:43.212044 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } W0513 07:35:43.212072 15421 api.go:53] PageSize not implemented I0513 07:35:43.212089 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:43.212211 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:43.212351 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:43.212447 15421 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0513 07:35:43.212494 15421 api.go:53] PageSize not implemented I0513 07:35:43.212526 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:43.212581 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:43.212582 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0513 07:35:43.212664 15421 api.go:53] PageSize not implemented I0513 07:35:43.212649 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0513 07:35:43.212683 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0513 07:35:43.212706 15421 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0513 07:35:43.212699 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:43.212641 15421 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0513 07:35:43.212764 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:43.212870 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:43.217399 15421 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0513 07:35:43.217495 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:43.217619 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:43.217674 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0513 07:35:43.217787 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:43.217940 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:43.218564 15421 executor.go:111] Tasks: 124 done / 132 total; 2 can run W0513 07:35:43.218691 15421 api.go:53] PageSize not implemented I0513 07:35:43.218721 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:43.218891 15421 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0513 07:35:43.219108 15421 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0513 07:35:43.221589 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0513 07:35:43.221638 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0513 07:35:43.221664 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:43.221687 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0513 07:35:43.221709 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0513 07:35:43.221730 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0513 07:35:43.221759 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0513 07:35:43.221785 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0513 07:35:43.221816 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0513 07:35:43.221842 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0513 07:35:43.221887 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:35:43.221912 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:35:43.221931 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:43.221955 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0513 07:35:43.221977 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0513 07:35:43.222000 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:43.222025 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:43.222050 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0513 07:35:43.222073 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0513 07:35:43.222100 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:43.222125 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:43.222146 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0513 07:35:43.222168 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:35:43.222189 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0513 07:35:43.222208 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:43.222231 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:43.222257 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0513 07:35:43.223386 15421 delete_cluster.go:128] Looking for cloud resources to delete W0513 07:35:43.223446 15421 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0513 07:35:43.223462 15421 keypairs.go:95] DescribeKeyPairs: { } I0513 07:35:43.223496 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.223542 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0513 07:35:43.223593 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.223642 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.223674 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.223706 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.223740 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.223771 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0513 07:35:43.223810 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.223849 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:43.223871 15421 natgateway.go:117] DescribeNatGateways: { } I0513 07:35:43.223904 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0513 07:35:43.223931 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W0513 07:35:43.223965 15421 api.go:53] PageSize not implemented I0513 07:35:43.223979 15421 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0513 07:35:43.224009 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:43.224029 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:43.224042 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0513 07:35:43.224071 15421 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0513 07:35:43.224088 15421 targetgroups.go:35] PageSize not implemented I0513 07:35:43.224102 15421 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0513 07:35:43.224147 15421 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0513 07:35:43.224183 15421 iamrole.go:89] ListRoles: { } I0513 07:35:43.224220 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:43.224241 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:43.224273 15421 internetgateways.go:101] DescribeInternetGateways: { } I0513 07:35:43.224316 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:43.224342 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0513 07:35:43.224369 15421 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0513 07:35:43.224395 15421 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0513 07:35:43.224846 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I0513 07:35:43.224897 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W0513 07:35:43.225001 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:43.225018 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok autoscaling-config:lt-1 ok I0513 07:35:43.225057 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:bastion.private-shared-ip.example.com ok I0513 07:35:43.225123 15421 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok I0513 07:35:43.225031 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0513 07:35:43.225001 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.private-shared-ip.example.com. ok I0513 07:35:43.225095 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } autoscaling-group:nodes.private-shared-ip.example.com ok W0513 07:35:43.225297 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:43.225319 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0513 07:35:43.225223 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } autoscaling-config:lt-2 ok I0513 07:35:43.225328 15421 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I0513 07:35:43.225362 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } iam-instance-profile:bastions.private-shared-ip.example.com ok I0513 07:35:43.225367 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0513 07:35:43.225393 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok I0513 07:35:43.225403 15421 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } load-balancer:api-private-shared-ip-exa-ohatqj ok I0513 07:35:43.225480 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0513 07:35:43.225519 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } iam-instance-profile:nodes.private-shared-ip.example.com ok I0513 07:35:43.225416 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W0513 07:35:43.225556 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:43.225575 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0513 07:35:43.225611 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0513 07:35:43.225670 15421 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-3 ok I0513 07:35:43.225757 15421 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0513 07:35:43.225850 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0513 07:35:43.225982 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I0513 07:35:43.225971 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } subnet:subnet-1 ok I0513 07:35:43.226040 15421 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0513 07:35:43.226034 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:43.226055 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0513 07:35:43.226090 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I0513 07:35:43.226076 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } W0513 07:35:43.226189 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:43.226164 15421 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0513 07:35:43.226208 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0513 07:35:43.226232 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0513 07:35:43.226249 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0513 07:35:43.226275 15421 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok I0513 07:35:43.226305 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I0513 07:35:43.226347 15421 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0513 07:35:43.226358 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0513 07:35:43.226378 15421 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I0513 07:35:43.226396 15421 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I0513 07:35:43.226467 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0513 07:35:43.226522 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (2.98s) === RUN TestLifecycleManyAddons I0513 07:35:43.227059 15421 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:35:43.227290 15421 internetgateways.go:66] CreateInternetGateway: { } I0513 07:35:43.227327 15421 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:35:43.227361 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:35:43.227392 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:35:43.227430 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:35:43.227462 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:35:43.227482 15421 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:35:43.227510 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:35:43.227532 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0513 07:35:43.248062 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:43.251057 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:43.251193 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:44.548803 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:45.221607 15421 iamrole.go:89] ListRoles: { } I0513 07:35:45.222463 15421 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0513 07:35:45.222771 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:45.222975 15421 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0513 07:35:45.222996 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:45.223108 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0513 07:35:45.222986 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0513 07:35:45.223158 15421 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0513 07:35:45.223203 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:45.223200 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0513 07:35:45.223263 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:45.224211 15421 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0513 07:35:45.224310 15421 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] } I0513 07:35:45.225398 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:45.225679 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:45.225857 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:45.226465 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:45.226770 15421 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.227001 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:45.227343 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:45.227689 15421 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0513 07:35:45.227931 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:45.228122 15421 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.228410 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:45.232260 15421 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0513 07:35:45.232415 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:45.232526 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0513 07:35:45.232626 15421 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0513 07:35:45.232670 15421 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0513 07:35:45.232615 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0513 07:35:45.232803 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0513 07:35:45.232759 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:45.232874 15421 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0513 07:35:45.232921 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0513 07:35:45.232944 15421 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0513 07:35:45.233006 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:45.232996 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0513 07:35:45.233055 15421 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] } I0513 07:35:45.233168 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:45.233243 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:45.233283 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:45.233317 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:45.233459 15421 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0513 07:35:45.233494 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0513 07:35:45.233631 15421 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0513 07:35:45.233699 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I0513 07:35:45.233777 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:45.233903 15421 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.233894 15421 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0513 07:35:45.233976 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:45.234036 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:45.234093 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:45.234142 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:45.234176 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:45.235077 15421 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0513 07:35:45.236699 15421 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0513 07:35:45.236871 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.237145 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0513 07:35:45.237283 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.237478 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.237607 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.237764 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.237957 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.238131 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:45.238234 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:45.238336 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:45.238438 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:45.238558 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:45.238628 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.238770 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0513 07:35:45.238876 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:45.238951 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:45.239037 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.239170 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.239274 15421 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0513 07:35:45.239318 15421 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0513 07:35:45.239416 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.239533 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0513 07:35:45.239570 15421 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0513 07:35:45.239600 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.239696 15421 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0513 07:35:45.239794 15421 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0513 07:35:45.239897 15421 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0513 07:35:45.240078 15421 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0513 07:35:45.240267 15421 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0513 07:35:45.240319 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:45.240351 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:45.240409 15421 dns.go:235] Pre-creating DNS records I0513 07:35:45.240436 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:45.245343 15421 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0513 07:35:45.248246 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:45.248316 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:46.531794 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:47.191557 15421 iamrole.go:89] ListRoles: { } I0513 07:35:47.192656 15421 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0513 07:35:47.192994 15421 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0513 07:35:47.193022 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.193503 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.193782 15421 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0513 07:35:47.194016 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.194187 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.194306 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:35:47.194343 15421 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:35:47.194407 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:47.195531 15421 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0513 07:35:47.195712 15421 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0513 07:35:47.195715 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0513 07:35:47.195867 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.196018 15421 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0513 07:35:47.196012 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0513 07:35:47.196182 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:47.196245 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:47.196351 15421 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:35:47.196411 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.196588 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:47.196722 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.196889 15421 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:35:47.200291 15421 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0513 07:35:47.200518 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:47.200699 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:47.200802 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:47.200962 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:47.201119 15421 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0513 07:35:47.201209 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:47.201302 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:47.201703 15421 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0513 07:35:47.201880 15421 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0513 07:35:47.202107 15421 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0513 07:35:47.204398 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0513 07:35:47.204449 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0513 07:35:47.204479 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0513 07:35:47.204500 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0513 07:35:47.204519 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0513 07:35:47.204538 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0513 07:35:47.204557 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0513 07:35:47.204617 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0513 07:35:47.204640 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0513 07:35:47.204670 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0513 07:35:47.204697 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0513 07:35:47.204719 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0513 07:35:47.204738 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0513 07:35:47.204777 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0513 07:35:47.204798 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:35:47.204819 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0513 07:35:47.204841 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:35:47.204864 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0513 07:35:47.204882 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0513 07:35:47.204900 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0513 07:35:47.204918 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0513 07:35:47.204941 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0513 07:35:47.204965 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:35:47.204986 15421 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0513 07:35:47.206293 15421 delete_cluster.go:128] Looking for cloud resources to delete W0513 07:35:47.206355 15421 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0513 07:35:47.206371 15421 keypairs.go:95] DescribeKeyPairs: { } I0513 07:35:47.206405 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.206442 15421 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0513 07:35:47.206482 15421 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.206525 15421 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.206557 15421 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.206595 15421 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.206627 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.206653 15421 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0513 07:35:47.206688 15421 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.206722 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0513 07:35:47.206749 15421 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0513 07:35:47.206783 15421 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0513 07:35:47.206811 15421 api.go:53] PageSize not implemented I0513 07:35:47.206832 15421 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0513 07:35:47.206854 15421 loadbalancers.go:35] PageSize not implemented I0513 07:35:47.206870 15421 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0513 07:35:47.206892 15421 targetgroups.go:35] PageSize not implemented I0513 07:35:47.206909 15421 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0513 07:35:47.206950 15421 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0513 07:35:47.206985 15421 iamrole.go:89] ListRoles: { } I0513 07:35:47.207024 15421 zones.go:93] ListHostedZonesPages { } I0513 07:35:47.207049 15421 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0513 07:35:47.207081 15421 internetgateways.go:101] DescribeInternetGateways: { } I0513 07:35:47.207120 15421 routetable.go:53] DescribeRouteTables: { } I0513 07:35:47.207150 15421 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0513 07:35:47.207479 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I0513 07:35:47.207574 15421 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0513 07:35:47.207640 15421 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0513 07:35:47.207718 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0513 07:35:47.207771 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0513 07:35:47.207621 15421 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.minimal.example.com. ok autoscaling-group:nodes.minimal.example.com ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0513 07:35:47.207792 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0513 07:35:47.207819 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0513 07:35:47.207923 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:47.207912 15421 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0513 07:35:47.207938 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0513 07:35:47.207951 15421 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0513 07:35:47.207964 15421 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0513 07:35:47.208017 15421 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W0513 07:35:47.208169 15421 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0513 07:35:47.208185 15421 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0513 07:35:47.208209 15421 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0513 07:35:47.208266 15421 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0513 07:35:47.208343 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0513 07:35:47.208384 15421 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0513 07:35:47.208399 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0513 07:35:47.208431 15421 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0513 07:35:47.208358 15421 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0513 07:35:47.208458 15421 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0513 07:35:47.208487 15421 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0513 07:35:47.208496 15421 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0513 07:35:47.208513 15421 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0513 07:35:47.208581 15421 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0513 07:35:47.208645 15421 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0513 07:35:47.208701 15421 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (3.98s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 208.641s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.008s ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I0513 07:32:19.383422 15830 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.003s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I0513 07:32:19.402598 15831 pod.go:59] starting pod controller I0513 07:32:19.402784 15831 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) PASS I0513 07:32:19.402861 15831 pod.go:107] Got stop signal I0513 07:32:19.402893 15831 pod.go:65] shutting down pod controller ok k8s.io/kops/dns-controller/pkg/watchers 0.024s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.003s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035630} route53_test.go:93: Got zone list: [0xc000035660] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baa48} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035760} route53_test.go:93: Got zone list: [0xc000035790] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baa58} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc000035860} route53_test.go:170: Successfully added managed DNS zone: &{0xc0003d9e00 0xc0000baa70} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000359e0} route53_test.go:93: Got zone list: [0xc000035a10] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baa88} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035b40} route53_test.go:93: Got zone list: [0xc000035b70] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baaa8} route53_test.go:187: Successfully added resource record set: {0xc0003ddd40 0xc0000baac8} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035e20} route53_test.go:93: Got zone list: [0xc000035e50] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bab50} route53_test.go:199: Successfully added resource record set: {0xc0003ddef0 0xc0000bab70} route53_test.go:118: Got 1 recordsets: [0xc00040a070] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040a1d0} route53_test.go:93: Got zone list: [0xc00040a200] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bac08} route53_test.go:221: Successfully added resource record set: {0xc000408120 0xc0000bac28} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000408120 0xc0000bac28}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040a590} route53_test.go:93: Got zone list: [0xc00040a5c0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bace0} route53_test.go:246: Successfully removed resource set {0xc000408360 0xc0000bad00} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040a870} route53_test.go:93: Got zone list: [0xc00040a8a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bad88} route53_test.go:264: Successfully removed resource set {0xc000408510 0xc0000bada8} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040ab80} route53_test.go:93: Got zone list: [0xc00040abb0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bae38} commontests.go:192: Successfully added resource record set: {0xc0004086c0 0xc0000bae58} commontests.go:45: Correctly replaced resource record {0xc0004086c0 0xc0000bae58} -> {0xc0004087e0 0xc0000baea8} commontests.go:142: Got 1 recordsets: [0xc00040aec0] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040b0c0} route53_test.go:93: Got zone list: [0xc00040b0f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baf58} commontests.go:192: Successfully added resource record set: {0xc000408ab0 0xc0000baf78} commontests.go:70: Correctly replaced resource record {0xc000408ab0 0xc0000baf78} -> {0xc000408bd0 0xc0000bafc8} commontests.go:142: Got 1 recordsets: [0xc00040b400] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040b650} route53_test.go:93: Got zone list: [0xc00040b680] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bb088} commontests.go:192: Successfully added resource record set: {0xc000408ea0 0xc0000bb0a8} commontests.go:142: Got 2 recordsets: [0xc00040b8f0 0xc00040b910] commontests.go:142: Got 2 recordsets: [0xc00040b980 0xc00040b9a0] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040bb70} route53_test.go:93: Got zone list: [0xc00040bba0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bb1a8} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.010s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.004s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc000360f00} clouddns_test.go:71: Got zone list: [0xc0001339b0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc000133980} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc000361000} clouddns_test.go:71: Got zone list: [0xc000133a70] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc000133a40} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc000361100} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc00037f000 0xc000133b30} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc0003611c0} clouddns_test.go:71: Got zone list: [0xc000133bf0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc000133bc0} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc0003612e0} clouddns_test.go:71: Got zone list: [0xc000133d28] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc000133cf8} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc000460040} clouddns_test.go:71: Got zone list: [0xc00000e198] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc00000e138} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc0004601a0} clouddns_test.go:71: Got zone list: [0xc00000e5b8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc00000e558} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc000460300} clouddns_test.go:71: Got zone list: [0xc00000e8e8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc00000e888} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc000460440} clouddns_test.go:71: Got zone list: [0xc00000ebb8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc00000eb58} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc0004605a0} clouddns_test.go:71: Got zone list: [0xc00000ed98] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc00000ed68} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc000460700} clouddns_test.go:71: Got zone list: [0xc00000f458] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc00000f428} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc000460880} clouddns_test.go:71: Got zone list: [0xc00000f788] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc00000f758} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00035e048 0xc000460a60} clouddns_test.go:71: Got zone list: [0xc00000fb60] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00037ee80 0xc00000fb30} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.041s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.018s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.005s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.050s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I0513 07:32:24.322663 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.322914 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.322958 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.323006 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.323044 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.323126 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.323171 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.323187 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.323230 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.323257 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.331771 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I0513 07:32:24.335969 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.336165 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.336195 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.336226 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.336248 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.336278 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.336304 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.336320 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.336341 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.336358 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.337490 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.00s) === RUN TestContainerdBuilder_Simple I0513 07:32:24.340749 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.341175 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.341196 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.341219 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.341232 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.341250 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.341268 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.341275 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.341289 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.341299 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.342016 16451 zones.go:93] ListHostedZonesPages { } I0513 07:32:24.343094 16451 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I0513 07:32:24.343104 16451 assetstore.go:111] bin/containerd I0513 07:32:24.343109 16451 assetstore.go:111] bin/containerd-shim I0513 07:32:24.343112 16451 assetstore.go:111] bin/containerd-shim-runc-v1 I0513 07:32:24.343115 16451 assetstore.go:111] bin/containerd-shim-runc-v2 I0513 07:32:24.343118 16451 assetstore.go:111] bin/containerd-stress I0513 07:32:24.343121 16451 assetstore.go:111] bin/ctr I0513 07:32:24.343140 16451 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I0513 07:32:24.343146 16451 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.01s) === RUN TestContainerdBuilder_Flatcar I0513 07:32:24.348270 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.348424 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.348457 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.348492 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.348515 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.348558 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.348591 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.348608 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.348632 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.348650 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.349775 16451 zones.go:93] ListHostedZonesPages { } I0513 07:32:24.351344 16451 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I0513 07:32:24.352404 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.352570 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.352598 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.352631 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.352654 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.352681 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.352703 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.352717 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.352739 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.352757 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.353845 16451 zones.go:93] ListHostedZonesPages { } I0513 07:32:24.355476 16451 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I0513 07:32:24.356200 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.356349 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.356386 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.356412 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.356433 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.356460 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.356484 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.356501 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.356524 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.356541 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.357566 16451 zones.go:93] ListHostedZonesPages { } I0513 07:32:24.359227 16451 assetstore.go:108] Matching assets for "^docker/": I0513 07:32:24.359241 16451 assetstore.go:111] docker/containerd I0513 07:32:24.359248 16451 assetstore.go:111] docker/containerd-shim I0513 07:32:24.359254 16451 assetstore.go:111] docker/ctr I0513 07:32:24.359258 16451 assetstore.go:111] docker/docker I0513 07:32:24.359262 16451 assetstore.go:111] docker/docker-init I0513 07:32:24.359266 16451 assetstore.go:111] docker/docker-proxy I0513 07:32:24.359270 16451 assetstore.go:111] docker/dockerd I0513 07:32:24.359274 16451 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.01s) === RUN TestDockerBuilder_LogFlags I0513 07:32:24.362301 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.362463 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.362488 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.362515 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.362537 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.362566 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.362592 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.362614 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.362638 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.362662 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.363739 16451 zones.go:93] ListHostedZonesPages { } I0513 07:32:24.365530 16451 assetstore.go:108] Matching assets for "^docker/": I0513 07:32:24.365550 16451 assetstore.go:111] docker/containerd I0513 07:32:24.365558 16451 assetstore.go:111] docker/containerd-shim I0513 07:32:24.365564 16451 assetstore.go:111] docker/ctr I0513 07:32:24.365569 16451 assetstore.go:111] docker/docker I0513 07:32:24.365574 16451 assetstore.go:111] docker/docker-init I0513 07:32:24.365578 16451 assetstore.go:111] docker/docker-proxy I0513 07:32:24.365582 16451 assetstore.go:111] docker/dockerd I0513 07:32:24.365587 16451 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.01s) === RUN TestDockerBuilder_SkipInstall I0513 07:32:24.368541 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.368728 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.368757 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.368787 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.368810 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.368844 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.368871 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.368887 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.368910 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.368927 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.369972 16451 zones.go:93] ListHostedZonesPages { } I0513 07:32:24.371625 16451 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I0513 07:32:24.371862 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.372219 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.372256 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.372286 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.372315 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.372345 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.372374 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.372389 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.372413 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.372430 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.373468 16451 zones.go:93] ListHostedZonesPages { } I0513 07:32:24.374975 16451 assetstore.go:108] Matching assets for "^docker/": I0513 07:32:24.374988 16451 assetstore.go:111] docker/docker I0513 07:32:24.374994 16451 assetstore.go:111] docker/docker-containerd I0513 07:32:24.374999 16451 assetstore.go:111] docker/docker-containerd-ctr I0513 07:32:24.375004 16451 assetstore.go:111] docker/docker-containerd-shim I0513 07:32:24.375008 16451 assetstore.go:111] docker/docker-init I0513 07:32:24.375013 16451 assetstore.go:111] docker/docker-proxy I0513 07:32:24.375017 16451 assetstore.go:111] docker/docker-runc I0513 07:32:24.375021 16451 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.01s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I0513 07:32:24.379185 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.379428 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.379500 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.379567 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.379656 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.379717 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.379778 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.379796 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.379818 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.379836 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.382120 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.01s) === RUN TestDockerHooksBuilder I0513 07:32:24.385209 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.385704 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.385728 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.385749 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.385766 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.385786 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.385803 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.385812 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.385826 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.385837 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.386962 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.00s) === RUN TestKopsControllerBuilder I0513 07:32:24.388404 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.388489 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.388503 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.388518 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.388529 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.388559 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.388576 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.388586 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.388598 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.388607 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.389490 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.00s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I0513 07:32:24.392951 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.393070 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.393089 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.393108 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.393121 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.393140 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.393157 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.393165 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.393181 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.393192 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.394219 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.01s) === RUN TestAuditConfigAPIServerBuilder I0513 07:32:24.400242 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.400375 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.400402 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.400436 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.400457 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.400489 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.400520 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.400536 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.400562 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.400579 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.402500 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I0513 07:32:24.408079 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.408209 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.408234 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.408268 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.408289 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.408319 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.408343 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.408359 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.408383 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.408402 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.409671 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I0513 07:32:24.413743 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.413870 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.413894 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.413924 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.413944 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.413974 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.413996 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.414013 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.414037 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.414052 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.415200 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I0513 07:32:24.420314 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.420437 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.420459 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.420480 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.420494 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.420514 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.420532 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.420542 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.420556 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.420568 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.421924 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I0513 07:32:24.426215 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.426327 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.426346 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.426366 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.426380 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.426399 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.426416 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.426426 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.426450 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.426462 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.427534 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I0513 07:32:24.433535 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:24.433649 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:24.433669 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:24.433692 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:24.433706 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:24.433726 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:24.433744 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:24.433753 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:24.433768 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:24.433779 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:24.435017 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.71s) === RUN TestKubeAPIServerBuilderARM64 I0513 07:32:26.147979 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:26.148091 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:26.148110 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:26.148132 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:26.148148 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:26.148167 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:26.148185 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:26.148194 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:26.148207 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:26.148218 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:26.149290 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.26s) === RUN TestKubeControllerManagerBuilder I0513 07:32:27.405023 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:27.405155 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:27.405179 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:27.405202 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:27.405243 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:27.405274 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:27.405297 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:27.405310 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:27.405328 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:27.405341 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:27.406664 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I0513 07:32:27.411300 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:27.411429 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:27.411449 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:27.411470 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:27.411485 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:27.411507 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:27.411525 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:27.411536 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:27.411553 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:27.411566 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:27.415105 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.24s) === RUN TestKubeControllerManagerBuilderARM64 I0513 07:32:28.652586 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:28.652756 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:28.652787 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:28.652824 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:28.652846 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:28.652879 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:28.652908 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:28.652926 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:28.652950 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:28.652967 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:28.654759 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.23s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I0513 07:32:29.880865 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:29.880975 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:29.880998 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:29.881020 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:29.881034 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:29.881051 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:29.881068 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:29.881077 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:29.881092 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:29.881105 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:29.882135 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.00s) === RUN TestKubeProxyBuilderAMD64 I0513 07:32:29.884240 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:29.884318 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:29.884332 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:29.884345 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:29.884356 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:29.884371 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:29.884384 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:29.884393 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:29.884405 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:29.884413 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:29.885314 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.26s) === RUN TestKubeProxyBuilderARM64 I0513 07:32:31.143691 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:31.144019 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:31.144078 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:31.144129 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:31.144176 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:31.144233 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:31.144283 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:31.144321 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:31.144368 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:31.144400 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:31.149751 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.24s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I0513 07:32:32.388921 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:32.389143 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:32.389183 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:32.389221 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:32.389263 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:32.389303 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:32.389349 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:32.389379 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:32.389416 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:32.389451 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:32.392497 16451 zones.go:93] ListHostedZonesPages { } W0513 07:32:32.395821 16451 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I0513 07:32:32.398130 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:32.398323 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:32.398360 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:32.398402 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:32.398428 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:32.398478 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:32.398507 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:32.398529 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:32.398597 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:32.398622 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:32.400749 16451 zones.go:93] ListHostedZonesPages { } W0513 07:32:33.672788 16451 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.28s) === RUN TestKubeSchedulerBuilderARM64 I0513 07:32:33.675158 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:33.675371 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:33.675407 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:33.675440 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:33.675468 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:33.675505 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:33.675540 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:33.675560 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:33.675590 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:33.675612 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:33.677730 16451 zones.go:93] ListHostedZonesPages { } W0513 07:32:34.933146 16451 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.26s) === RUN TestKubectlBuilder I0513 07:32:34.935537 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:34.935749 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:34.935784 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:34.935818 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:34.935850 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:34.935889 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:34.935921 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:34.935941 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:34.935976 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:34.935997 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:34.938097 16451 zones.go:93] ListHostedZonesPages { } I0513 07:32:34.940557 16451 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I0513 07:32:34.945361 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:34.945546 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:34.945575 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:34.945608 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:34.945633 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:34.945663 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:34.945688 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:34.945709 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:34.945735 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:34.945753 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:34.947380 16451 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I0513 07:32:34.951982 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:34.952151 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:34.952180 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:34.952206 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:34.952232 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:34.952264 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:34.952289 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:34.952311 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:34.952335 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:34.952353 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:34.953861 16451 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.01s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I0513 07:32:34.958115 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:34.958285 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:34.958316 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:34.958345 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:34.958370 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:34.958401 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:34.958425 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:34.958446 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:34.958469 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:34.958487 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:34.960431 16451 zones.go:93] ListHostedZonesPages { } I0513 07:32:34.962755 16451 assetstore.go:108] Matching assets for "protokube$": I0513 07:32:34.962778 16451 assetstore.go:111] /opt/kops/bin/protokube I0513 07:32:34.962792 16451 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I0513 07:32:34.962816 16451 assetstore.go:108] Matching assets for "channels$": I0513 07:32:34.962827 16451 assetstore.go:111] /opt/kops/bin/channels I0513 07:32:34.962837 16451 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I0513 07:32:34.964513 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:34.964681 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:34.964712 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:34.964740 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:34.964764 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:34.964795 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:34.964821 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:34.964843 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:34.964871 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:34.964889 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:34.966816 16451 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I0513 07:32:34.969662 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:34.969835 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:34.969865 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:34.969895 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:34.969921 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:34.969953 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:34.969980 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:34.970000 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:34.970026 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:34.970044 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:34.971942 16451 zones.go:93] ListHostedZonesPages { } I0513 07:32:34.974231 16451 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.00s) === RUN TestUpdateServiceBuilderExternal I0513 07:32:34.974707 16451 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:34.974873 16451 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:34.974901 16451 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:34.974928 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:34.974954 16451 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:34.974990 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:34.975019 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:34.975040 16451 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:34.975066 16451 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:34.975085 16451 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:34.977078 16451 zones.go:93] ListHostedZonesPages { } I0513 07:32:34.979410 16451 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.00s) PASS ok k8s.io/kops/nodeup/pkg/model 10.742s ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.038s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.031s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.028s ? k8s.io/kops/pkg/apis/kops/registry [no test files] === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E0513 07:32:24.255910 16455 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E0513 07:32:24.256043 16455 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.010s ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I0513 07:32:24.310495 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310590 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310614 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310628 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310642 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I0513 07:32:24.310797 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310821 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310837 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310855 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310884 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310903 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310924 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310941 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310960 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310979 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.310994 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.311022 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.311038 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.311054 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.311069 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.311106 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.311129 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.311142 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0513 07:32:24.311157 16456 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I0513 07:32:24.311279 16456 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I0513 07:32:24.311317 16456 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.075s ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.014s ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W0513 07:32:24.288977 16458 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W0513 07:32:24.290010 16458 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W0513 07:32:24.290666 16458 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W0513 07:32:24.291340 16458 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W0513 07:32:24.292002 16458 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W0513 07:32:24.293777 16458 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host W0513 07:32:24.294648 16458 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E0513 07:32:24.295099 16458 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E0513 07:32:24.295109 16458 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E0513 07:32:24.295113 16458 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E0513 07:32:24.295117 16458 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.053s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.005s ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.063s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.031s ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.105s ? k8s.io/kops/pkg/commands/commandutils [no test files] === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.099s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.031s ? k8s.io/kops/pkg/configserver [no test files] === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.004s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.005s ? k8s.io/kops/pkg/dump [no test files] === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.036s === RUN TestFlagToFalse I0513 07:32:24.271451 16697 featureflag_test.go:32] Created flag Unittest1 I0513 07:32:24.271506 16697 featureflag.go:164] FeatureFlag "UnitTest1"=false I0513 07:32:24.271515 16697 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I0513 07:32:24.271572 16697 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.004s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.023s === RUN TestRenderInstanceGroupZones W0513 07:32:25.482822 17593 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.019s === RUN TestWarmPoolOnlyRoll I0513 07:32:36.886046 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.886114 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.886134 18466 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I0513 07:32:36.886564 18466 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0513 07:32:36.886592 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.887724 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.887750 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.892918 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.892969 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.892984 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.892993 18466 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0513 07:32:36.894208 18466 instancegroups.go:431] Draining the node: "master-1a.local". I0513 07:32:36.894650 18466 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0513 07:32:36.894703 18466 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0513 07:32:36.894718 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.895816 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.895830 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.901012 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.901048 18466 instancegroups.go:431] Draining the node: "master-1b.local". I0513 07:32:36.901513 18466 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0513 07:32:36.901580 18466 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0513 07:32:36.901602 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.902773 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.902808 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.908021 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.908063 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.908105 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.908121 18466 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0513 07:32:36.908878 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:36.909405 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:36.909432 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.910537 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.910553 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.915753 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.915812 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:36.916511 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:36.916537 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.917677 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.917692 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.922880 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.922936 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:36.923592 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:36.923614 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.924716 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.924730 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.929910 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.929934 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.929942 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.929950 18466 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0513 07:32:36.930410 18466 instancegroups.go:431] Draining the node: "node-2a.local". I0513 07:32:36.930694 18466 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0513 07:32:36.930710 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.931815 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.931825 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.936990 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.937027 18466 instancegroups.go:431] Draining the node: "node-2b.local". I0513 07:32:36.937435 18466 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0513 07:32:36.937452 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.938540 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.938562 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.943743 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.943777 18466 instancegroups.go:431] Draining the node: "node-2c.local". I0513 07:32:36.944304 18466 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0513 07:32:36.944332 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.945453 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.945463 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.950656 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.950680 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.06s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I0513 07:32:36.950948 18466 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0513 07:32:36.950962 18466 instancegroups.go:469] waiting for 1ms after terminating instance W0513 07:32:36.952076 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0513 07:32:36.952110 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0513 07:32:36.952135 18466 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0513 07:32:36.952145 18466 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0513 07:32:36.952160 18466 instancegroups.go:469] waiting for 1ms after terminating instance W0513 07:32:36.953256 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0513 07:32:36.953280 18466 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0513 07:32:36.953287 18466 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0513 07:32:36.953300 18466 instancegroups.go:469] waiting for 1ms after terminating instance W0513 07:32:36.954391 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0513 07:32:36.954406 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0513 07:32:36.954427 18466 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0513 07:32:36.954434 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:36.954446 18466 instancegroups.go:469] waiting for 1ms after terminating instance W0513 07:32:36.955533 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0513 07:32:36.955554 18466 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0513 07:32:36.955561 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:36.955573 18466 instancegroups.go:469] waiting for 1ms after terminating instance W0513 07:32:36.956660 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0513 07:32:36.956679 18466 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0513 07:32:36.956693 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:36.956703 18466 instancegroups.go:469] waiting for 1ms after terminating instance W0513 07:32:36.957793 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0513 07:32:36.957810 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0513 07:32:36.957832 18466 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0513 07:32:36.957838 18466 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0513 07:32:36.957851 18466 instancegroups.go:469] waiting for 1ms after terminating instance W0513 07:32:36.958947 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0513 07:32:36.958973 18466 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0513 07:32:36.958981 18466 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0513 07:32:36.958995 18466 instancegroups.go:469] waiting for 1ms after terminating instance W0513 07:32:36.960126 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0513 07:32:36.960152 18466 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0513 07:32:36.960159 18466 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0513 07:32:36.960173 18466 instancegroups.go:469] waiting for 1ms after terminating instance W0513 07:32:36.961276 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0513 07:32:36.961297 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I0513 07:32:36.961511 18466 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0513 07:32:36.961527 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.962620 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.962637 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.962645 18466 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.962666 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.962677 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.962684 18466 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.962688 18466 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0513 07:32:36.963043 18466 instancegroups.go:431] Draining the node: "master-1a.local". I0513 07:32:36.963309 18466 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0513 07:32:36.963344 18466 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0513 07:32:36.963353 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.964474 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.964489 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.964497 18466 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.964520 18466 instancegroups.go:431] Draining the node: "master-1b.local". I0513 07:32:36.964912 18466 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0513 07:32:36.964951 18466 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0513 07:32:36.964965 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.966060 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.966077 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.966087 18466 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.966098 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.966107 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.966113 18466 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.966120 18466 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0513 07:32:36.966578 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:36.966966 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:36.966982 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.968107 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.968121 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.968129 18466 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.968142 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:36.968421 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:36.968433 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.969522 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.969538 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.969547 18466 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.969564 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:36.969963 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:36.969980 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.971074 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.971093 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.971103 18466 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.971113 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.971120 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.971127 18466 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.971135 18466 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0513 07:32:36.971634 18466 instancegroups.go:431] Draining the node: "node-2a.local". I0513 07:32:36.972077 18466 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0513 07:32:36.972100 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.973195 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.973210 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.973221 18466 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.973238 18466 instancegroups.go:431] Draining the node: "node-2b.local". I0513 07:32:36.973621 18466 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0513 07:32:36.973639 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.974747 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.974760 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.974767 18466 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.974781 18466 instancegroups.go:431] Draining the node: "node-2c.local". I0513 07:32:36.975034 18466 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0513 07:32:36.975046 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.976135 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.976151 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0513 07:32:36.976161 18466 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0513 07:32:36.976176 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.01s) === RUN TestRollingUpdateNoneNeedUpdate I0513 07:32:36.976351 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I0513 07:32:36.976497 18466 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0513 07:32:36.976511 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.977609 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.977624 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.983539 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.983607 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.983624 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.983633 18466 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0513 07:32:36.984189 18466 instancegroups.go:431] Draining the node: "master-1a.local". I0513 07:32:36.984606 18466 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0513 07:32:36.984660 18466 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0513 07:32:36.984684 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.985805 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.985823 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.990987 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.991028 18466 instancegroups.go:431] Draining the node: "master-1b.local". I0513 07:32:36.991413 18466 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0513 07:32:36.991452 18466 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0513 07:32:36.991465 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:36.992573 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.992592 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:36.997778 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.997815 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:36.997828 18466 instancegroups.go:540] Cluster validated. I0513 07:32:36.997838 18466 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0513 07:32:36.998486 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:36.998974 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:36.998999 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.000132 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.000147 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.005836 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.005878 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:37.006269 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:37.006285 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.007468 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.007498 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.012704 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.012763 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:37.013349 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:37.013369 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.014919 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.014942 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.020138 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.020167 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.020180 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.020190 18466 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0513 07:32:37.020847 18466 instancegroups.go:431] Draining the node: "node-2a.local". I0513 07:32:37.021277 18466 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0513 07:32:37.021295 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.022382 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.022395 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.027655 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.027712 18466 instancegroups.go:431] Draining the node: "node-2b.local". I0513 07:32:37.028178 18466 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0513 07:32:37.028200 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.029311 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.029326 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.034532 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.034568 18466 instancegroups.go:431] Draining the node: "node-2c.local". I0513 07:32:37.034947 18466 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0513 07:32:37.034962 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.036075 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.036095 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.041276 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.041308 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.06s) === RUN TestRollingUpdateEmptyGroup I0513 07:32:37.041453 18466 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I0513 07:32:37.041722 18466 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0513 07:32:37.041740 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.043157 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.043181 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0513 07:32:37.043193 18466 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I0513 07:32:37.043440 18466 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0513 07:32:37.043458 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.044565 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.044579 18466 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0513 07:32:37.044593 18466 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I0513 07:32:37.044722 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.044736 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0513 07:32:37.044746 18466 instancegroups.go:509] Cluster did not validate within 0s E0513 07:32:37.044757 18466 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I0513 07:32:37.044837 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.044847 18466 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0513 07:32:37.044856 18466 instancegroups.go:509] Cluster did not validate within 0s E0513 07:32:37.044866 18466 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I0513 07:32:37.044969 18466 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0513 07:32:37.044983 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.046076 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.046090 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.051279 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.051326 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.051347 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.051356 18466 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0513 07:32:37.051740 18466 instancegroups.go:431] Draining the node: "master-1a.local". I0513 07:32:37.052019 18466 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0513 07:32:37.052058 18466 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0513 07:32:37.052070 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.053162 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.053190 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0513 07:32:37.053202 18466 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I0513 07:32:37.053453 18466 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0513 07:32:37.053471 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.054580 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.054594 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.059766 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.059807 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.059817 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.059829 18466 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0513 07:32:37.060177 18466 instancegroups.go:431] Draining the node: "master-1a.local". I0513 07:32:37.060422 18466 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0513 07:32:37.060460 18466 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0513 07:32:37.060472 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.061571 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.061589 18466 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0513 07:32:37.061602 18466 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I0513 07:32:37.061787 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.061800 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.061807 18466 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0513 07:32:37.064200 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:37.065162 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:37.065189 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.066315 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.066345 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.071627 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.071678 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:37.072137 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:37.072156 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.073291 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.073307 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.078506 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.078535 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:37.078913 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:37.078929 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.080073 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.080107 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.085255 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.085290 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I0513 07:32:37.085539 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.085551 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0513 07:32:37.085560 18466 instancegroups.go:509] Cluster did not validate within 0s E0513 07:32:37.085567 18466 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I0513 07:32:37.085687 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.085696 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0513 07:32:37.085702 18466 instancegroups.go:509] Cluster did not validate within 0s E0513 07:32:37.085707 18466 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I0513 07:32:37.085792 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.085800 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0513 07:32:37.085805 18466 instancegroups.go:509] Cluster did not validate within 0s E0513 07:32:37.085811 18466 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I0513 07:32:37.085907 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.085916 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.085920 18466 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0513 07:32:37.086312 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:37.086569 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:37.086583 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.087674 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.087690 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.092861 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.092907 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:37.093479 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:37.093503 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.094648 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.094668 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.099825 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.099854 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:37.100251 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:37.100267 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.101358 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.101370 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.106537 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.106551 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.106559 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0513 07:32:37.106567 18466 instancegroups.go:509] Cluster did not validate within 0s E0513 07:32:37.106576 18466 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I0513 07:32:37.106704 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.106713 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.106718 18466 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0513 07:32:37.107078 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:37.107325 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:37.107339 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.108646 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.108671 18466 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0513 07:32:37.108681 18466 instancegroups.go:509] Cluster did not validate within 0s E0513 07:32:37.108692 18466 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I0513 07:32:37.108829 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.108843 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.108850 18466 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0513 07:32:37.109227 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:37.109474 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:37.109486 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.110600 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.110610 18466 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0513 07:32:37.110618 18466 instancegroups.go:509] Cluster did not validate within 0s E0513 07:32:37.110624 18466 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I0513 07:32:37.110723 18466 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0513 07:32:37.110733 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.111833 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.111849 18466 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0513 07:32:37.112948 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.118111 18466 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0513 07:32:37.119205 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.124360 18466 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0513 07:32:37.125448 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.130633 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.130695 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.130715 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.130727 18466 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0513 07:32:37.131303 18466 instancegroups.go:431] Draining the node: "master-1a.local". I0513 07:32:37.131722 18466 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0513 07:32:37.131787 18466 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0513 07:32:37.131810 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.132920 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.132941 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.138135 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.138186 18466 instancegroups.go:431] Draining the node: "master-1b.local". I0513 07:32:37.138596 18466 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0513 07:32:37.138636 18466 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0513 07:32:37.138649 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.139735 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.139762 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.144923 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.144945 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.144957 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.144963 18466 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0513 07:32:37.145344 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:37.145602 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:37.145615 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.146698 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.146715 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.151822 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.151857 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:37.152279 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:37.152295 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.153405 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.153430 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.158573 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.158599 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:37.158939 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:37.158953 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.160079 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.160097 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.165262 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.165275 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.165284 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.165290 18466 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0513 07:32:37.165685 18466 instancegroups.go:431] Draining the node: "node-2a.local". I0513 07:32:37.165938 18466 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0513 07:32:37.165959 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.167070 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.167095 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.172325 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.172358 18466 instancegroups.go:431] Draining the node: "node-2b.local". I0513 07:32:37.172733 18466 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0513 07:32:37.172748 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.173860 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.173884 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.179073 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.179096 18466 instancegroups.go:431] Draining the node: "node-2c.local". I0513 07:32:37.179393 18466 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0513 07:32:37.179409 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.180513 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.180533 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.185714 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.185741 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I0513 07:32:37.185920 18466 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0513 07:32:37.185934 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.187025 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.187043 18466 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0513 07:32:37.188136 18466 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0513 07:32:37.189255 18466 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0513 07:32:37.190339 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.195512 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.195564 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.195573 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.195581 18466 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0513 07:32:37.195930 18466 instancegroups.go:431] Draining the node: "master-1a.local". I0513 07:32:37.196164 18466 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0513 07:32:37.196201 18466 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0513 07:32:37.196215 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.197325 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.197338 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.202549 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.202602 18466 instancegroups.go:431] Draining the node: "master-1b.local". I0513 07:32:37.203123 18466 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0513 07:32:37.203161 18466 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0513 07:32:37.203175 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.204291 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.204323 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.209568 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.209607 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.209624 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.209635 18466 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0513 07:32:37.210259 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:37.210580 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:37.210595 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.211709 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.211722 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.216910 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.216941 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:37.217396 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:37.217414 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.218569 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.218585 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.223799 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.223840 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:37.224286 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:37.224310 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.225440 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.225462 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.230625 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.230645 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.230653 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.230659 18466 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0513 07:32:37.231158 18466 instancegroups.go:431] Draining the node: "node-2a.local". I0513 07:32:37.231515 18466 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0513 07:32:37.231538 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.232684 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.232702 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.237881 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.237936 18466 instancegroups.go:431] Draining the node: "node-2b.local". I0513 07:32:37.238480 18466 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0513 07:32:37.238501 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.239606 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.239629 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.244799 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.244837 18466 instancegroups.go:431] Draining the node: "node-2c.local". I0513 07:32:37.245371 18466 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0513 07:32:37.245393 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.246489 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.246508 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.251670 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.251693 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I0513 07:32:37.252116 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.252128 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.252135 18466 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0513 07:32:37.252525 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:37.252926 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:37.252945 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.254040 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.254053 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.259218 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.259255 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:37.259767 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:37.259788 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.261031 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.261047 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.266194 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.266213 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I0513 07:32:37.266371 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.266380 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.266385 18466 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0513 07:32:37.266686 18466 instancegroups.go:431] Draining the node: "master-1a.local". I0513 07:32:37.266938 18466 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0513 07:32:37.266969 18466 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0513 07:32:37.266981 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.268126 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.268137 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.273319 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.273337 18466 instancegroups.go:431] Draining the node: "master-1b.local". I0513 07:32:37.273624 18466 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0513 07:32:37.273664 18466 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0513 07:32:37.273676 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.274809 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.274820 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.280009 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.280027 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I0513 07:32:37.280211 18466 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W0513 07:32:37.280230 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0513 07:32:37.280237 18466 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W0513 07:32:37.280242 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0513 07:32:37.280247 18466 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W0513 07:32:37.280250 18466 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0513 07:32:37.280254 18466 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0513 07:32:37.280260 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I0513 07:32:37.280364 18466 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I0513 07:32:37.280385 18466 instancegroups.go:203] waiting for 1ms after detaching instance I0513 07:32:37.281486 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.281497 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.286708 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.286721 18466 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I0513 07:32:37.286743 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.286751 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.286756 18466 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0513 07:32:37.287076 18466 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I0513 07:32:37.287085 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.287091 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.287095 18466 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0513 07:32:37.287389 18466 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0513 07:32:37.287414 18466 instancegroups.go:203] waiting for 1ms after detaching instance I0513 07:32:37.288523 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.288534 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.293715 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.293737 18466 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I0513 07:32:37.293748 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.293758 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.293766 18466 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0513 07:32:37.294307 18466 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I0513 07:32:37.294349 18466 instancegroups.go:203] waiting for 1ms after detaching instance I0513 07:32:37.295468 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.295479 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:37.300671 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.300684 18466 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0513 07:32:37.300695 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I0513 07:32:37.300836 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.300848 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.300854 18466 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0513 07:32:37.301563 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:37.301842 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:37.301859 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.302981 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.302996 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.303012 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:37.303075 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:37.303294 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:37.303485 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:37.303499 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.304576 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.304600 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.404925 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.404986 18466 instancegroups.go:431] Draining the node: "node-1e.local". I0513 07:32:37.405005 18466 instancegroups.go:431] Draining the node: "node-1d.local". I0513 07:32:37.405436 18466 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0513 07:32:37.405763 18466 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0513 07:32:37.405788 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.406927 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.406944 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.406956 18466 instancegroups.go:431] Draining the node: "node-1f.local". I0513 07:32:37.407347 18466 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0513 07:32:37.407380 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.408536 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.408574 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.509612 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.509676 18466 instancegroups.go:431] Draining the node: "node-1g.local". I0513 07:32:37.510319 18466 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0513 07:32:37.510361 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.511543 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.511591 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.511613 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I0513 07:32:37.511836 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.511858 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.511870 18466 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0513 07:32:37.513192 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:37.513195 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:37.513925 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:37.514082 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:37.514107 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.515241 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.515283 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.615718 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.615790 18466 instancegroups.go:431] Draining the node: "node-1d.local". I0513 07:32:37.615822 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:37.616753 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:37.616946 18466 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0513 07:32:37.616978 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.618130 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.618150 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.618164 18466 instancegroups.go:431] Draining the node: "node-1e.local". I0513 07:32:37.618457 18466 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0513 07:32:37.618474 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.619668 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.619695 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.720156 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.720217 18466 instancegroups.go:431] Draining the node: "node-1f.local". I0513 07:32:37.720635 18466 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0513 07:32:37.720659 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.721850 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.721920 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.721944 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I0513 07:32:37.722147 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.722170 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.722181 18466 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I0513 07:32:37.723581 18466 instancegroups.go:431] Draining the node: "master-1a.local". I0513 07:32:37.724089 18466 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0513 07:32:37.724138 18466 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0513 07:32:37.724166 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.725281 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.725308 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.725334 18466 instancegroups.go:431] Draining the node: "master-1c.local". I0513 07:32:37.725354 18466 instancegroups.go:431] Draining the node: "master-1b.local". I0513 07:32:37.726117 18466 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I0513 07:32:37.726158 18466 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I0513 07:32:37.726322 18466 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0513 07:32:37.726364 18466 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0513 07:32:37.726390 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.727586 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.727637 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.828026 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.828068 18466 instancegroups.go:431] Draining the node: "master-1e.local". I0513 07:32:37.828133 18466 instancegroups.go:431] Draining the node: "master-1d.local". I0513 07:32:37.828971 18466 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I0513 07:32:37.829032 18466 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I0513 07:32:37.829210 18466 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I0513 07:32:37.829261 18466 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I0513 07:32:37.829294 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.830399 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.830420 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.830437 18466 instancegroups.go:431] Draining the node: "master-1f.local". I0513 07:32:37.830807 18466 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I0513 07:32:37.830835 18466 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I0513 07:32:37.830850 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.831993 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.832021 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.932412 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.932461 18466 instancegroups.go:431] Draining the node: "master-1g.local". I0513 07:32:37.932986 18466 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I0513 07:32:37.933035 18466 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I0513 07:32:37.933062 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.934259 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.934293 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.934313 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I0513 07:32:37.934520 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.934550 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.934561 18466 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0513 07:32:37.935853 18466 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0513 07:32:37.935906 18466 instancegroups.go:203] waiting for 1ms after detaching instance I0513 07:32:37.937009 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.937026 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.937032 18466 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0513 07:32:37.937057 18466 instancegroups.go:203] waiting for 1ms after detaching instance I0513 07:32:37.938193 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.938216 18466 instancegroups.go:540] Cluster validated. I0513 07:32:37.938246 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:37.938261 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:37.939064 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:37.939218 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:37.939242 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:37.940349 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:37.940373 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.040751 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.040819 18466 instancegroups.go:431] Draining the node: "node-1d.local". I0513 07:32:38.040847 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:38.041487 18466 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0513 07:32:38.041594 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:38.041614 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.042737 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.042758 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.042774 18466 instancegroups.go:431] Draining the node: "node-1e.local". I0513 07:32:38.043095 18466 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0513 07:32:38.043117 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.044260 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.044290 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.144751 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.144814 18466 instancegroups.go:431] Draining the node: "node-1f.local". I0513 07:32:38.145580 18466 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0513 07:32:38.145632 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.146839 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.146875 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.146899 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I0513 07:32:38.147102 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.147127 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.147139 18466 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0513 07:32:38.148425 18466 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0513 07:32:38.148463 18466 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0513 07:32:38.148496 18466 instancegroups.go:203] waiting for 1ms after detaching instance I0513 07:32:38.149716 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.149749 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.149781 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:38.149819 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:38.150252 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:38.150519 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:38.150539 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.151736 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.151786 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.252185 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.252270 18466 instancegroups.go:431] Draining the node: "node-1d.local". I0513 07:32:38.252281 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:38.252737 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:38.253850 18466 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0513 07:32:38.253927 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.255336 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.255358 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.255377 18466 instancegroups.go:431] Draining the node: "node-1e.local". I0513 07:32:38.255674 18466 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0513 07:32:38.255692 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.256969 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.257032 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.357728 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.357791 18466 instancegroups.go:431] Draining the node: "node-1f.local". I0513 07:32:38.358883 18466 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0513 07:32:38.358951 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.360099 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.360140 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.360171 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I0513 07:32:38.360431 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.360457 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.360471 18466 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0513 07:32:38.361211 18466 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0513 07:32:38.361243 18466 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I0513 07:32:38.361288 18466 instancegroups.go:203] waiting for 1ms after detaching instance I0513 07:32:38.362422 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.362451 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:38.367627 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.367676 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:38.367746 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:38.368615 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:38.368650 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.368754 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:38.368776 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.369794 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.369821 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:38.375026 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.375069 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I0513 07:32:38.375396 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.375426 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.375441 18466 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0513 07:32:38.376256 18466 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E0513 07:32:38.376321 18466 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I0513 07:32:38.376337 18466 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E0513 07:32:38.376370 18466 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I0513 07:32:38.376412 18466 instancegroups.go:203] waiting for 1ms after detaching instance I0513 07:32:38.377530 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.377551 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:38.382835 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.382882 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:38.382938 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:38.383803 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:38.383833 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.384069 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:38.384098 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.385023 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.385048 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:38.390406 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.390437 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.02s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I0513 07:32:38.390640 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.390667 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.390681 18466 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I0513 07:32:38.391988 18466 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0513 07:32:38.392039 18466 instancegroups.go:203] waiting for 1ms after detaching instance I0513 07:32:38.393193 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.393214 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.393221 18466 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0513 07:32:38.393247 18466 instancegroups.go:203] waiting for 1ms after detaching instance I0513 07:32:38.394399 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.394431 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.394463 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:38.394516 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:38.394549 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:38.395585 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:38.395622 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.395798 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:38.395833 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.396018 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:38.396049 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.396781 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.497737 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.497795 18466 instancegroups.go:431] Draining the node: "node-1d.local". I0513 07:32:38.498425 18466 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0513 07:32:38.498461 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.499653 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.499686 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.499705 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I0513 07:32:38.499911 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.499935 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.499946 18466 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0513 07:32:38.501333 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:38.501845 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:38.501901 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.503078 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.503107 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.503136 18466 instancegroups.go:431] Draining the node: "node-1e.local". I0513 07:32:38.503196 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:38.504006 18466 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0513 07:32:38.504161 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:38.504184 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.505330 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.505381 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.606508 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.606574 18466 instancegroups.go:431] Draining the node: "node-1g.local". I0513 07:32:38.606611 18466 instancegroups.go:431] Draining the node: "node-1f.local". I0513 07:32:38.607387 18466 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0513 07:32:38.607529 18466 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0513 07:32:38.607552 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.608723 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.608759 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.608788 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:38.609375 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:38.609411 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.610578 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.610608 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.711217 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.711274 18466 instancegroups.go:431] Draining the node: "node-1d.local". I0513 07:32:38.711838 18466 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0513 07:32:38.711902 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.713044 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.713092 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.713124 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I0513 07:32:38.713263 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.713279 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.713287 18466 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0513 07:32:38.713293 18466 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0513 07:32:38.713297 18466 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0513 07:32:38.713307 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I0513 07:32:38.713376 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.713385 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.713390 18466 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0513 07:32:38.713766 18466 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0513 07:32:38.713776 18466 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0513 07:32:38.713780 18466 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0513 07:32:38.713796 18466 instancegroups.go:431] Draining the node: "node-1a.local". I0513 07:32:38.714074 18466 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0513 07:32:38.714087 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.715276 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.715298 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:38.720529 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.720555 18466 instancegroups.go:431] Draining the node: "node-1b.local". I0513 07:32:38.720905 18466 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0513 07:32:38.720920 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.722081 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.722103 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:38.727309 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.727331 18466 instancegroups.go:431] Draining the node: "node-1c.local". I0513 07:32:38.727729 18466 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0513 07:32:38.727757 18466 instancegroups.go:469] waiting for 1ms after terminating instance I0513 07:32:38.729541 18466 instancegroups.go:504] Validating the cluster. I0513 07:32:38.729558 18466 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0513 07:32:38.734757 18466 instancegroups.go:540] Cluster validated. I0513 07:32:38.734798 18466 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 1.926s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.005s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.012s === RUN TestParse E0513 07:32:36.825002 18469 versions.go:96] unable to parse Kubernetes version "" E0513 07:32:36.825082 18469 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.011s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.035s ? k8s.io/kops/pkg/kopscontrollerclient [no test files] === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.12s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.186s ? k8s.io/kops/pkg/kubemanifest [no test files] === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.080s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.068s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.067s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I0513 07:32:36.868138 18475 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.058s ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] === RUN Test_RunEtcdManagerBuilder I0513 07:32:36.877060 18476 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W0513 07:32:36.906338 18476 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W0513 07:32:36.908027 18476 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.03s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.101s ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] === RUN Test_RunKubeApiserverBuilder I0513 07:32:36.880632 18477 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.079s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.082s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.026s ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.075s === RUN TestServerGroupBuilder I0513 07:32:36.886052 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:36.896609 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:36.906125 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:36.917291 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:36.926257 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:36.937645 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:36.947998 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:36.956017 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:36.965804 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:37.030347 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:37.034919 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:37.040322 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:37.046329 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:37.051052 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:37.056128 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:37.060587 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:37.065159 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:37.071510 18482 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.23s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.305s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.031s ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.032s ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.033s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.01s) --- PASS: TestGenerateCertificate/selfsigned (0.00s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (0.75s) --- PASS: TestIssueCert/ca (0.25s) --- PASS: TestIssueCert/client (0.42s) --- PASS: TestIssueCert/clientOneYear (0.08s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 0.760s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.005s ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] === RUN TestAddUntaggedRouteTables I0513 07:32:41.707057 20186 routetable.go:53] DescribeRouteTables: { } W0513 07:32:41.707179 20186 tags.go:67] cluster tag not found on route-table:rtb-1234 I0513 07:32:41.707197 20186 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I0513 07:32:41.707332 20186 iaminstanceprofile.go:193] ListInstanceProfiles: { } W0513 07:32:41.707421 20186 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I0513 07:32:41.707492 20186 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I0513 07:32:41.707578 20186 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I0513 07:32:41.707642 20186 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I0513 07:32:41.707718 20186 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I0513 07:32:41.708116 20186 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I0513 07:32:41.708152 20186 volumes.go:128] DescribeVolumes: { } W0513 07:32:41.708185 20186 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I0513 07:32:41.708321 20186 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:41.708526 20186 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:41.708568 20186 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:41.708636 20186 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:41.708660 20186 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:41.708713 20186 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:41.708757 20186 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:41.708771 20186 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:41.708792 20186 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:41.708818 20186 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:41.708841 20186 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I0513 07:32:41.708864 20186 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I0513 07:32:41.708884 20186 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I0513 07:32:41.708924 20186 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I0513 07:32:41.708945 20186 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I0513 07:32:41.708975 20186 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I0513 07:32:41.709007 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I0513 07:32:41.709042 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I0513 07:32:41.709064 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I0513 07:32:41.709083 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I0513 07:32:41.709105 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I0513 07:32:41.709123 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I0513 07:32:41.709150 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I0513 07:32:41.709166 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I0513 07:32:41.709188 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I0513 07:32:41.709209 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I0513 07:32:41.709239 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I0513 07:32:41.709256 20186 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.067s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.029s ? k8s.io/kops/pkg/resources/digitalocean [no test files] === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.063s ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.005s ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.005s ? k8s.io/kops/pkg/try [no test files] === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.004s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.005s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.004s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.01s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.045s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.073s ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.006s ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] === RUN TestRemovesDuplicateGuardedBlocks W0513 07:32:41.653963 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.654024 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.654030 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.654036 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.654042 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.654048 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.654055 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.654060 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.654066 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.654071 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.654097 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.654108 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.654114 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.654119 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.654124 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.654129 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.669596 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.669615 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.669661 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.669667 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.669717 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.669729 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.669786 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.669797 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.669850 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.669859 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.669927 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.669936 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.669987 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.669996 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670055 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670077 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670132 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670141 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670205 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670215 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670277 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670286 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670336 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670344 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670394 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670402 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670452 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670461 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670512 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670521 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670575 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670583 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670638 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670647 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670685 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670692 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670749 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670756 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670832 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670842 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670887 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670896 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670936 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.670941 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.670983 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671001 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671046 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671055 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671102 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671108 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671144 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671150 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671185 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671190 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671225 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671230 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671263 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671268 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671306 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671312 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671346 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671351 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671387 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671392 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671426 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671431 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671464 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671469 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671513 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671523 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671576 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671583 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671639 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671644 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671679 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671684 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671717 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671732 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671769 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671777 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671829 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671836 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671872 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671890 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671930 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671935 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.671974 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.671982 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672021 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672033 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672069 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672075 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672113 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672122 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672168 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672175 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672209 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672215 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672255 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672261 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672294 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672300 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672334 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672340 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672374 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672379 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672412 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672418 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672452 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672457 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672491 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672496 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672529 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672534 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672569 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672576 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.672627 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.672635 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673279 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673290 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673345 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673360 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673414 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673420 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673473 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673478 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673513 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673518 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673549 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673554 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673585 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673589 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673619 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673624 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673654 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673658 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673689 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673693 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673724 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673729 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673759 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673764 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673797 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673801 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673833 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673838 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673870 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673875 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673904 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673910 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673939 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673943 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.673972 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.673978 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674012 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674019 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674067 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674074 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674117 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674124 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674163 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674170 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674220 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674228 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674274 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674284 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674341 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674348 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674394 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674401 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674444 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674452 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674494 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674501 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674544 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674550 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674591 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674597 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674643 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674649 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674693 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674700 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674744 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674751 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674794 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674801 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674845 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674852 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674897 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674904 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.674949 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.674956 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.675000 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675012 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.675060 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675068 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.675113 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675123 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.02s) === RUN TestRecoversFromBadNesting W0513 07:32:41.675674 20201 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0513 07:32:41.675684 20201 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0513 07:32:41.675690 20201 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0513 07:32:41.675696 20201 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0513 07:32:41.675700 20201 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0513 07:32:41.675705 20201 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0513 07:32:41.675709 20201 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0513 07:32:41.675727 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675735 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675741 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.675746 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675751 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.675756 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675764 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.675768 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675773 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.675777 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675782 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675786 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675792 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675796 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.675801 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.675806 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682320 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682337 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682378 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682384 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682417 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682422 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682459 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682466 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682520 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682526 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682559 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682564 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682596 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682601 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682634 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682639 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682671 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682675 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682707 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682712 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682760 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682765 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682799 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682805 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682842 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682847 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682881 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682885 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682916 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682928 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.682962 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.682967 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683002 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683007 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683039 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683044 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683075 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683079 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683112 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683117 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683149 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683154 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683185 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683190 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683223 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683228 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683260 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683265 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683297 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683302 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683335 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683339 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683372 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683377 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683409 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683414 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683456 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683462 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683494 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683499 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683531 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683535 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683566 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683571 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683602 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683607 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683639 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683644 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683676 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683681 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683714 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683721 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683753 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683758 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683789 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683794 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683830 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683835 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683866 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683873 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683905 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683910 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683954 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683961 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.683993 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.683998 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684030 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684035 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684068 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684073 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684105 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684110 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684146 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684152 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684185 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684190 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684222 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684227 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684259 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684264 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684296 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684300 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684333 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684338 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684370 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684375 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684417 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684422 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684454 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684460 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684491 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684496 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684527 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684533 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684564 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684569 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684601 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684606 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684639 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684644 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684678 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684683 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684715 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684720 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684753 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684758 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684791 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684797 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684841 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684849 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684896 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684903 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.684947 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.684956 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685003 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685010 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685053 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685059 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685102 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685109 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685152 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685159 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685204 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685220 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685266 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685273 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685319 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685328 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685371 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685378 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685424 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685432 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685476 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685483 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685544 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685554 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685600 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685608 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685652 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685660 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685704 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685712 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685758 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685765 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685811 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685820 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685882 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685893 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.685945 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.685953 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686000 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686008 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686061 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686068 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686114 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686126 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686178 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686188 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686238 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686246 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686293 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686301 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686351 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686359 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686406 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686415 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686463 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686471 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686514 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686520 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686552 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686557 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686598 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686605 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686650 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686658 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0513 07:32:41.686708 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0513 07:32:41.686723 20201 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.01s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.039s ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.01s) PASS ok k8s.io/kops/tests/codecs 0.032s ? k8s.io/kops/tests/fuzz [no test files] === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.01s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.01s) --- PASS: TestChannelImages/stable-channel (0.01s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.063s ? k8s.io/kops/tests/integration/channel/simple [no test files] === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.01s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.01s) PASS ok k8s.io/kops/tests/integration/conversion 0.030s ? k8s.io/kops/upup/models [no test files] === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I0513 07:32:44.178394 22491 files.go:57] Writing file "/tmp/TestWriteFile416702599/001/SubDir/test1.tmp" I0513 07:32:44.178594 22491 files.go:113] Changing file mode for "/tmp/TestWriteFile416702599/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.026s === RUN TestBootstrapChannelBuilder_BuildTasks I0513 07:32:48.433153 22836 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:48.433328 22836 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:48.433355 22836 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:48.433388 22836 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:48.433403 22836 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:48.433433 22836 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:48.433455 22836 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:48.433464 22836 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:48.433487 22836 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:48.433503 22836 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:48.438043 22836 zones.go:93] ListHostedZonesPages { } I0513 07:32:48.492787 22836 zones.go:93] ListHostedZonesPages { } I0513 07:32:48.597163 22836 zones.go:93] ListHostedZonesPages { } I0513 07:32:48.737034 22836 zones.go:93] ListHostedZonesPages { } I0513 07:32:48.879211 22836 zones.go:93] ListHostedZonesPages { } I0513 07:32:48.982587 22836 zones.go:93] ListHostedZonesPages { } I0513 07:32:49.089291 22836 zones.go:93] ListHostedZonesPages { } I0513 07:32:49.238046 22836 zones.go:93] ListHostedZonesPages { } I0513 07:32:49.813544 22836 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.51s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I0513 07:32:49.942881 22836 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:49.943077 22836 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:49.943156 22836 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:49.943196 22836 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:49.943225 22836 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:49.943266 22836 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:49.943299 22836 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:49.943319 22836 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:49.943345 22836 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:49.943365 22836 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:49.943388 22836 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I0513 07:32:49.944808 22836 zones.go:93] ListHostedZonesPages { } I0513 07:32:50.103870 22836 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.16s) === RUN TestBootstrapChannelBuilder_AWSCloudController I0513 07:32:50.104138 22836 featureflag.go:164] FeatureFlag "ImageDigest"=false I0513 07:32:50.104330 22836 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:50.104391 22836 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0513 07:32:50.104441 22836 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0513 07:32:50.104472 22836 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0513 07:32:50.104509 22836 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0513 07:32:50.104541 22836 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0513 07:32:50.104561 22836 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0513 07:32:50.104588 22836 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0513 07:32:50.104611 22836 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0513 07:32:50.106091 22836 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.13s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.17s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W0513 07:32:50.427598 22836 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I0513 07:32:50.476270 22836 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I0513 07:32:50.476342 22836 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I0513 07:32:50.476354 22836 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I0513 07:32:50.476418 22836 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I0513 07:32:50.476430 22836 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I0513 07:32:50.476495 22836 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I0513 07:32:50.476559 22836 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I0513 07:32:50.476627 22836 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0513 07:32:50.476645 22836 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I0513 07:32:50.476720 22836 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0513 07:32:50.476739 22836 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I0513 07:32:50.476850 22836 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I0513 07:32:50.476967 22836 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I0513 07:32:50.477037 22836 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I0513 07:32:50.477050 22836 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I0513 07:32:50.477058 22836 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I0513 07:32:50.477076 22836 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I0513 07:32:50.477085 22836 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I0513 07:32:50.477093 22836 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I0513 07:32:50.477101 22836 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I0513 07:32:50.477108 22836 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I0513 07:32:50.478504 22836 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I0513 07:32:50.478758 22836 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.135s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I0513 07:32:48.421056 22837 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender1379018494/001 I0513 07:32:48.421484 22837 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender1379018494/001 I0513 07:32:48.421784 22837 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender1379018494/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I0513 07:32:48.426237 22837 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0513 07:32:48.426338 22837 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0513 07:32:48.426415 22837 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I0513 07:32:48.426525 22837 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0513 07:32:48.426638 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.426718 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.426739 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.426885 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:32:48.426921 22837 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0513 07:32:48.426959 22837 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0513 07:32:48.427018 22837 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0513 07:32:48.427100 22837 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0513 07:32:48.427154 22837 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0513 07:32:48.427193 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.427233 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.427248 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.427278 22837 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0513 07:32:48.427314 22837 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0513 07:32:48.427378 22837 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I0513 07:32:48.427531 22837 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0513 07:32:48.427592 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.427684 22837 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0513 07:32:48.427739 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:32:48.427757 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.427776 22837 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0513 07:32:48.427837 22837 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0513 07:32:48.427976 22837 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0513 07:32:48.428018 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:32:48.428042 22837 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:32:48.428066 22837 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0513 07:32:48.428118 22837 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:32:48.428235 22837 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I0513 07:32:48.428286 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:32:48.428307 22837 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I0513 07:32:48.428341 22837 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0513 07:32:48.428397 22837 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0513 07:32:48.428435 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.428476 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.428490 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.428513 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.428535 22837 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0513 07:32:48.428579 22837 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0513 07:32:48.428632 22837 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:32:48.428658 22837 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0513 07:32:48.428695 22837 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:32:48.428739 22837 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I0513 07:32:48.428762 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0513 07:32:48.428800 22837 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I0513 07:32:48.428870 22837 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0513 07:32:48.428905 22837 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0513 07:32:48.428924 22837 internetgateways.go:66] CreateInternetGateway: { } I0513 07:32:48.428940 22837 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I0513 07:32:48.428985 22837 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0513 07:32:48.429026 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.429065 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.429079 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.429133 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:32:48.429157 22837 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0513 07:32:48.429187 22837 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0513 07:32:48.429241 22837 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0513 07:32:48.429316 22837 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0513 07:32:48.429364 22837 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0513 07:32:48.429404 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.429443 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.429457 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.429489 22837 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0513 07:32:48.429523 22837 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0513 07:32:48.429575 22837 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I0513 07:32:48.430029 22837 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender2323267893/001 I0513 07:32:48.430382 22837 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender2323267893/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I0513 07:32:48.430742 22837 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0513 07:32:48.430784 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.430861 22837 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0513 07:32:48.430892 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:32:48.430911 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.430932 22837 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0513 07:32:48.430997 22837 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0513 07:32:48.431143 22837 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I0513 07:32:48.431180 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0513 07:32:48.431204 22837 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0513 07:32:48.431249 22837 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0513 07:32:48.431285 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.431311 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.431320 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.431334 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.431348 22837 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0513 07:32:48.431372 22837 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0513 07:32:48.431410 22837 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I0513 07:32:48.431566 22837 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0513 07:32:48.431591 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.431637 22837 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0513 07:32:48.431655 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:32:48.431666 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.431679 22837 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0513 07:32:48.431701 22837 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0513 07:32:48.431748 22837 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0513 07:32:48.431770 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:32:48.431781 22837 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:32:48.431794 22837 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0513 07:32:48.431830 22837 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0513 07:32:48.431852 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.431882 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.431895 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.431908 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.431922 22837 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0513 07:32:48.431943 22837 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0513 07:32:48.431971 22837 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:32:48.431983 22837 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I0513 07:32:48.432058 22837 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0513 07:32:48.432081 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.432131 22837 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0513 07:32:48.432150 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:32:48.432162 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.432177 22837 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0513 07:32:48.432200 22837 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0513 07:32:48.432247 22837 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0513 07:32:48.432277 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:32:48.432292 22837 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:32:48.432350 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.432509 22837 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0513 07:32:48.432543 22837 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0513 07:32:48.432633 22837 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0513 07:32:48.432663 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.432695 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.432704 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.432718 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.432731 22837 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0513 07:32:48.432756 22837 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0513 07:32:48.432793 22837 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:32:48.432804 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.432825 22837 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I0513 07:32:48.432914 22837 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0513 07:32:48.432937 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.432984 22837 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0513 07:32:48.433008 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:32:48.433021 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.433033 22837 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0513 07:32:48.433083 22837 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0513 07:32:48.433181 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.433201 22837 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0513 07:32:48.433258 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:32:48.433272 22837 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:32:48.433286 22837 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0513 07:32:48.433302 22837 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0513 07:32:48.433336 22837 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0513 07:32:48.433359 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.433380 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.433388 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.433412 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.433424 22837 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0513 07:32:48.433445 22837 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0513 07:32:48.433501 22837 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:32:48.433514 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.433539 22837 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I0513 07:32:48.433575 22837 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I0513 07:32:48.433621 22837 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I0513 07:32:48.433657 22837 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0513 07:32:48.433679 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.433703 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.433711 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.433752 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:32:48.433772 22837 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0513 07:32:48.433796 22837 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0513 07:32:48.433822 22837 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:32:48.433883 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0513 07:32:48.433896 22837 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0513 07:32:48.433911 22837 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0513 07:32:48.433944 22837 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0513 07:32:48.433965 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.433984 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.433991 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.434007 22837 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0513 07:32:48.434025 22837 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0513 07:32:48.434051 22837 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I0513 07:32:48.434101 22837 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.434122 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.434160 22837 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0513 07:32:48.434176 22837 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0513 07:32:48.434187 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.434197 22837 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0513 07:32:48.434218 22837 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.434238 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0513 07:32:48.434258 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.434266 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.434279 22837 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0513 07:32:48.434290 22837 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I0513 07:32:48.434350 22837 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I0513 07:32:48.434389 22837 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.434410 22837 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I0513 07:32:48.434429 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0513 07:32:48.434438 22837 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0513 07:32:48.434454 22837 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.062s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.044s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.028s === RUN TestDiskRenderAzure I0513 07:32:48.402600 22840 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I0513 07:32:48.402932 22840 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I0513 07:32:48.403118 22840 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I0513 07:32:48.403698 22840 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I0513 07:32:48.403866 22840 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I0513 07:32:48.404071 22840 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I0513 07:32:48.404227 22840 resourcegroup.go:108] Creating a new Resource Group with name: rg I0513 07:32:48.404234 22840 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I0513 07:32:48.404354 22840 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I0513 07:32:48.404826 22840 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I0513 07:32:48.405010 22840 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I0513 07:32:48.405187 22840 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I0513 07:32:48.405417 22840 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I0513 07:32:48.405579 22840 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.032s ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.032s ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] === RUN TestProjectIAMBinding I0513 07:32:48.432084 22842 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.432446 22842 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0513 07:32:48.432460 22842 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.432715 22842 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0513 07:32:48.432732 22842 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.432812 22842 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I0513 07:32:48.432893 22842 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.432946 22842 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0513 07:32:48.432957 22842 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.433024 22842 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0513 07:32:48.433043 22842 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.433071 22842 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I0513 07:32:48.433132 22842 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.433276 22842 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0513 07:32:48.433288 22842 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.433496 22842 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0513 07:32:48.433511 22842 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0513 07:32:48.433579 22842 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.060s ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.056s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.043s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.030s ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.030s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.005s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.031s ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I0513 07:32:48.428855 22848 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I0513 07:32:48.428901 22848 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I0513 07:32:48.428908 22848 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I0513 07:32:48.428916 22848 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I0513 07:32:48.428922 22848 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I0513 07:32:48.428928 22848 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I0513 07:32:48.428933 22848 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W0513 07:32:48.429242 22848 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.056s ? k8s.io/kops/upup/pkg/fi/secrets [no test files] === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.005s ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.004s ? k8s.io/kops/util/pkg/env [no test files] === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.004s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.005s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.005s ? k8s.io/kops/util/pkg/mirrors [no test files] === RUN TestGetProxyEnvVars W0513 07:32:48.400491 22855 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.025s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.031s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.004s ? k8s.io/kops/util/pkg/tables [no test files] === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.005s ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.028s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W0513 07:32:52.387273 23314 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.052s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... kubernetes >>> kops*: Package size: 146.3 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.4-r10.apk >>> kops: Build complete at Tue, 13 May 2025 07:35:49 +0000 elapsed time 0h 5m 5s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/4) Purging .makedepends-kops (20250513.073046) (2/4) Purging kubernetes (1.32.2-r3) (3/4) Purging go (1.24.3-r1) (4/4) Purging bash (5.2.37-r0) Executing bash-5.2.37-r0.pre-deinstall Executing busybox-1.37.0-r17.trigger OK: 400 MiB in 106 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...