>>> kops: Building testing/kops 1.28.4-r8 (using abuild 3.14.1-r7) started Mon, 17 Mar 2025 23:12:52 +0000 >>> kops: Validating /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/4) Installing kubernetes (1.32.2-r1) (2/4) Installing go (1.24.1-r0) (3/4) Installing bash (5.2.37-r0) Executing bash-5.2.37-r0.post-install (4/4) Installing .makedepends-kops (20250317.231253) Executing busybox-1.37.0-r14.trigger OK: 593 MiB in 111 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 32.7M 100 32.7M 0 0 79.3M 0 --:--:-- --:--:-- --:--:-- 79.4M >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz >>> kops: Checking sha512sums... kops-1.28.4.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.4.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.4 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading github.com/spf13/cobra v1.7.0 go: downloading github.com/spf13/pflag v1.0.5 go: downloading k8s.io/apimachinery v0.28.1 go: downloading k8s.io/kubectl v0.28.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading go.uber.org/multierr v1.11.0 go: downloading golang.org/x/crypto v0.14.0 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading k8s.io/api v0.28.1 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading k8s.io/client-go v0.28.1 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading k8s.io/klog v1.0.0 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading golang.org/x/net v0.17.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/google/uuid v1.3.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/kr/fs v0.1.0 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading golang.org/x/sys v0.13.0 go: downloading golang.org/x/term v0.13.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading golang.org/x/time v0.3.0 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading golang.org/x/text v0.13.0 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading google.golang.org/protobuf v1.31.0 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/google/s2a-go v0.1.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/docker/go-units v0.5.0 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/josharian/intern v1.0.0 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/moby/locker v1.0.1 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I0317 23:14:23.963465 31754 addon.go:250] addon test wants to update all nodes I0317 23:14:23.964729 31754 addon.go:250] addon test wants to update workers nodes I0317 23:14:23.964952 31754 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I0317 23:14:23.965213 31754 addon.go:283] installing PKI for "test" I0317 23:14:24.431429 31754 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.61s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.653s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.044s ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN TestCreateClusterMinimal I0317 23:14:25.350470 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:25.350643 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:25.350669 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:25.350698 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:25.350719 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:25.350752 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:25.350778 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:25.350787 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:25.350806 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:25.350822 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:25.355788 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.355833 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.435965 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:25.436188 32978 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0317 23:14:25.436569 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:25.444229 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:25.444321 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:25.444338 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:25.444357 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:25.444373 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:25.444392 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:25.444408 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:25.444418 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:25.444432 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:25.444442 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:25.446698 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.446733 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.490368 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:25.490477 32978 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0317 23:14:25.490700 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:25.495981 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:25.496083 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:25.496103 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:25.496128 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:25.496142 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:25.496162 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:25.496181 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:25.496189 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:25.496203 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:25.496215 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:25.498592 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.498620 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.582179 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:25.582297 32978 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0317 23:14:25.582545 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:25.585995 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:25.586090 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:25.586108 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:25.586128 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:25.586143 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:25.586163 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:25.586182 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:25.586191 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:25.586206 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:25.586218 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:25.832223 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.832257 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.847253 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:25.847351 32978 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0317 23:14:25.847540 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:25.850831 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:25.850933 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:25.850950 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:25.850969 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:25.850984 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:25.851002 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:25.851018 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:25.851028 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:25.851042 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:25.851053 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:25.853007 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.853039 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.952786 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:25.952905 32978 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0317 23:14:25.953099 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:25.956175 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:25.956278 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:25.956295 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:25.956314 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:25.956327 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:25.956345 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:25.956362 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:25.956370 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:25.956384 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:25.956395 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:25.958747 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.958779 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:25.993822 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:25.993898 32978 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0317 23:14:25.994086 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:25.997496 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:25.997598 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:25.997615 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:25.997635 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:25.997649 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:25.997667 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:25.997684 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:25.997694 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:25.997709 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:25.997720 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:26.000007 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.000054 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.085600 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:26.085718 32978 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0317 23:14:26.085947 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.74s) === RUN TestCreateClusterHetzner I0317 23:14:26.089370 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:26.089488 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:26.089506 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:26.089526 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:26.089541 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:26.089561 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:26.089579 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:26.089588 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:26.089614 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:26.089626 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:26.091826 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.091854 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0317 23:14:26.351626 32978 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0317 23:14:26.351656 32978 new_cluster.go:1373] Cloud Provider ID: "hetzner" I0317 23:14:26.355910 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:26.356028 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:26.356047 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:26.356068 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:26.356083 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:26.356101 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:26.356119 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:26.356130 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:26.356145 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:26.356156 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:26.358735 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.358795 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.414658 32978 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.33s) === RUN TestCreateClusterOpenStack I0317 23:14:26.421156 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:26.421287 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:26.421309 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:26.421334 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:26.421352 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:26.421374 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:26.421403 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:26.421415 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:26.421431 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:26.421444 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:26.424129 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.424159 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0317 23:14:26.441601 32978 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0317 23:14:26.441637 32978 new_cluster.go:1373] Cloud Provider ID: "openstack" I0317 23:14:26.442860 32978 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.03s) === RUN TestCreateClusterOpenStackOctavia I0317 23:14:26.447481 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:26.447590 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:26.447609 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:26.447628 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:26.447642 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:26.447659 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:26.447676 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:26.447685 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:26.447698 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:26.447712 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:26.449980 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.450047 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0317 23:14:26.533063 32978 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0317 23:14:26.533102 32978 new_cluster.go:1373] Cloud Provider ID: "openstack" I0317 23:14:26.534381 32978 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0317 23:14:26.534397 32978 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.09s) === RUN TestCreateClusterOpenStackNoDNS I0317 23:14:26.540236 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:26.540354 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:26.540374 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:26.540394 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:26.540419 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:26.540439 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:26.540456 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:26.540466 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:26.540482 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:26.540494 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:26.543352 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.543382 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0317 23:14:26.705343 32978 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0317 23:14:26.705371 32978 new_cluster.go:1373] Cloud Provider ID: "openstack" I0317 23:14:26.705401 32978 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0317 23:14:26.705409 32978 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.17s) === RUN TestCreateClusterCilium I0317 23:14:26.710636 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:26.710757 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:26.710784 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:26.710807 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:26.710829 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:26.710851 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:26.710873 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:26.710884 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:26.710905 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:26.710925 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:26.715780 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.715833 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.742449 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:26.742591 32978 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0317 23:14:26.742809 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.04s) === RUN TestCreateClusterOverride I0317 23:14:26.746534 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:26.746639 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:26.746660 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:26.746691 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:26.746710 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:26.746737 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:26.746777 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:26.746794 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:26.746818 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:26.746833 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:26.749846 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.749903 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.862843 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:26.863166 32978 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0317 23:14:26.863386 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.12s) === RUN TestCreateClusterKubernetesFeatureGates I0317 23:14:26.866851 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:26.866960 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:26.866980 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:26.867002 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:26.867018 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:26.867036 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:26.867056 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:26.867068 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:26.867093 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:26.867113 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:26.869389 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.869419 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.886066 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:26.886209 32978 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0317 23:14:26.886474 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.02s) === RUN TestCreateClusterComplex I0317 23:14:26.890569 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:26.890679 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:26.890701 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:26.890732 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:26.890753 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:26.890780 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:26.890802 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:26.890819 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:26.890842 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:26.890858 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:26.893217 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.893241 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.917561 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:26.917777 32978 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I0317 23:14:26.917785 32978 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I0317 23:14:26.917792 32978 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I0317 23:14:26.918035 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.04s) === RUN TestCreateClusterComplexPrivate I0317 23:14:26.926574 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:26.926697 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:26.926717 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:26.926740 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:26.926781 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:26.926804 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:26.926823 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:26.926832 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:26.926844 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:26.926857 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:26.929789 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:26.929851 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.029428 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:27.029651 32978 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I0317 23:14:27.029659 32978 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I0317 23:14:27.029663 32978 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I0317 23:14:27.029666 32978 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I0317 23:14:27.029670 32978 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I0317 23:14:27.029673 32978 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I0317 23:14:27.029676 32978 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I0317 23:14:27.029685 32978 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I0317 23:14:27.029691 32978 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I0317 23:14:27.029694 32978 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I0317 23:14:27.030004 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.11s) === RUN TestCreateClusterHA I0317 23:14:27.037167 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:27.037270 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:27.037288 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:27.037306 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:27.037321 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:27.037338 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:27.037355 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:27.037365 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:27.037380 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:27.037391 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:27.289902 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.289935 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.359840 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:27.360021 32978 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0317 23:14:27.360029 32978 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0317 23:14:27.360032 32978 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0317 23:14:27.360270 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:27.365552 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:27.365652 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:27.365668 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:27.365688 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:27.365702 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:27.365720 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:27.365737 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:27.365746 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:27.365759 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:27.365769 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:27.369306 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.369356 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.461621 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:27.461957 32978 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0317 23:14:27.461967 32978 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0317 23:14:27.461971 32978 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0317 23:14:27.462290 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.44s) === RUN TestCreateClusterMinimalGCE I0317 23:14:27.477136 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:27.477413 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:27.477463 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:27.477511 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:27.477544 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:27.477593 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:27.477639 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:27.477669 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:27.477709 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:27.477735 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:27.485288 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.485344 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.509082 32978 new_cluster.go:1373] Cloud Provider ID: "gce" I0317 23:14:27.509213 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I0317 23:14:27.514544 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:27.514694 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:27.514719 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:27.514747 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:27.514768 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:27.514796 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:27.514821 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:27.514834 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:27.514854 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:27.514869 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:27.518570 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.518616 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.548259 32978 new_cluster.go:1373] Cloud Provider ID: "gce" I0317 23:14:27.548319 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.07s) === RUN TestCreateClusterHAGCE I0317 23:14:27.551803 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:27.551916 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:27.551934 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:27.551951 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:27.551966 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:27.551984 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:27.552001 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:27.552010 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:27.552024 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:27.552035 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:27.554313 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.554349 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.649205 32978 new_cluster.go:1373] Cloud Provider ID: "gce" I0317 23:14:27.649297 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.10s) === RUN TestCreateClusterGCE I0317 23:14:27.654599 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:27.654709 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:27.654727 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:27.654746 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:27.654762 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:27.654780 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:27.654798 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:27.654808 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:27.654823 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:27.654835 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:27.657156 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.657180 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.757713 32978 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0317 23:14:27.757773 32978 new_cluster.go:1373] Cloud Provider ID: "gce" I0317 23:14:27.757832 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.11s) === RUN TestCreateClusterHASharedZone I0317 23:14:27.761560 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:27.761666 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:27.761683 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:27.761703 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:27.761718 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:27.761736 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:27.761753 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:27.761762 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:27.761776 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:27.761786 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:27.764208 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.764231 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0317 23:14:27.799194 32978 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0317 23:14:27.799232 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:27.799374 32978 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0317 23:14:27.799583 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.04s) === RUN TestCreateClusterHASharedZones I0317 23:14:27.804218 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:27.804331 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:27.804348 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:27.804367 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:27.804381 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:27.804400 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:27.804417 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:27.804428 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:27.804442 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:27.804452 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:27.806647 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.806681 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0317 23:14:27.833329 32978 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0317 23:14:27.833369 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:27.833606 32978 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I0317 23:14:27.833617 32978 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I0317 23:14:27.833876 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.04s) === RUN TestCreateClusterPrivate I0317 23:14:27.840140 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:27.840247 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:27.840266 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:27.840286 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:27.840302 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:27.840322 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:27.840341 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:27.840351 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:27.840366 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:27.840377 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:27.842905 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.842928 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.920934 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:27.921058 32978 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0317 23:14:27.921069 32978 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0317 23:14:27.921264 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:27.921293 32978 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.09s) === RUN TestCreateClusterPrivateGCE I0317 23:14:27.926184 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:27.926448 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:27.926480 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:27.926535 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:27.926563 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:27.926602 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:27.926637 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:27.926655 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:27.926685 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:27.926702 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:27.931645 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:27.931673 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.019819 32978 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0317 23:14:28.019872 32978 new_cluster.go:1373] Cloud Provider ID: "gce" I0317 23:14:28.019937 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.10s) === RUN TestCreateClusterWithNGWSpecified I0317 23:14:28.024215 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:28.024319 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:28.024337 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:28.024356 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:28.024371 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:28.024389 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:28.024405 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:28.024415 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:28.024429 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:28.024440 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:28.026950 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.026971 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.055550 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:28.055683 32978 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0317 23:14:28.055694 32978 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0317 23:14:28.055895 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:28.055919 32978 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.04s) === RUN TestCreateClusterWithINGWSpecified I0317 23:14:28.060108 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:28.060217 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:28.060234 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:28.060254 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:28.060270 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:28.060289 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:28.060306 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:28.060315 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:28.060330 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:28.060341 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:28.062680 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.062722 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.126921 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:28.127049 32978 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0317 23:14:28.127066 32978 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0317 23:14:28.127278 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:28.127315 32978 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.07s) === RUN TestCreateClusterSharedVPC I0317 23:14:28.131327 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:28.131425 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:28.131442 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:28.131459 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:28.131473 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:28.131491 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:28.131508 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:28.131519 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:28.131533 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:28.131542 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:28.134150 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.134174 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.226197 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:28.226331 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.226362 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.226381 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.226390 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.226415 32978 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I0317 23:14:28.226609 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.10s) === RUN TestCreateClusterSharedSubnets I0317 23:14:28.229963 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:28.230066 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:28.230090 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:28.230111 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:28.230124 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:28.230142 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:28.230162 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:28.230170 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:28.230183 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:28.230193 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:28.232611 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.232632 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.309725 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.309767 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.309836 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:28.309933 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.309946 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.309962 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.309972 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.310224 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.08s) === RUN TestCreateClusterSharedSubnetsVpcLookup I0317 23:14:28.314147 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:28.314257 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:28.314274 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:28.314291 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:28.314306 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:28.314324 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:28.314341 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:28.314351 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:28.314367 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:28.314378 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:28.317468 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.317536 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.499219 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:14:28.499264 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.499282 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.499368 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:28.499510 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.499529 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.499550 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.499563 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.499874 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.19s) === RUN TestCreateClusterPrivateSharedSubnets I0317 23:14:28.505112 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:28.505264 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:28.505288 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:28.505312 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:28.505332 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:28.505358 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:28.505384 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:28.505397 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:28.505417 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:28.505434 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:28.508254 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.508286 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.700275 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.700304 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.700339 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.700348 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.700396 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:28.700481 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.700492 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.700504 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:14:28.700512 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:14:28.700730 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.20s) === RUN TestCreateClusterIPv6 I0317 23:14:28.704285 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:28.704384 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:28.704399 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:28.704416 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:28.704430 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:28.704447 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:28.704463 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:28.704472 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:28.704486 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:28.704496 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:28.706917 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.706938 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.742875 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:28.742988 32978 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I0317 23:14:28.742998 32978 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I0317 23:14:28.743301 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.04s) === RUN TestCreateClusterDifferentAMIs I0317 23:14:28.746965 32978 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0317 23:14:28.746974 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:28.747073 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:28.747090 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:28.747110 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:28.747125 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:28.747143 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:28.747159 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:28.747167 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:28.747182 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:28.747193 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:28.749431 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.749464 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.866825 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:28.866883 32978 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0317 23:14:28.866893 32978 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0317 23:14:28.867107 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:28.871191 32978 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.12s) === RUN TestCreateClusterKarpenter I0317 23:14:28.871260 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:28.871358 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:28.871374 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:28.871393 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:28.871408 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:28.871426 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:28.871443 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:28.871452 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:28.871465 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:28.871475 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:28.873746 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.873778 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0317 23:14:28.902197 32978 new_cluster.go:1373] Cloud Provider ID: "aws" I0317 23:14:28.902329 32978 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0317 23:14:28.902338 32978 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0317 23:14:28.902344 32978 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0317 23:14:28.902561 32978 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.04s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I0317 23:14:28.906549 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:28.906647 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:28.906668 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:28.906724 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:28.906754 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:28.906788 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:28.906809 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:28.906825 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:28.906849 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:28.906864 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:28.910012 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.00s) === RUN TestMinimal I0317 23:14:28.910844 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:28.910937 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:28.910954 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:28.910978 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:28.910997 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:28.911021 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:28.911038 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:28.911055 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:28.911078 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:28.911091 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:28.919356 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0317 23:14:28.920434 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:28.920472 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0317 23:14:33.854179 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:36.988411 32978 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0317 23:14:36.995679 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:14:36.995722 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:14:36.995812 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:14:36.997239 32978 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0317 23:14:37.002241 32978 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0317 23:14:37.002847 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:37.002956 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:37.003118 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:37.003513 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:37.003595 32978 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0317 23:14:37.003956 32978 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0317 23:14:37.004338 32978 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0317 23:14:37.009770 32978 target.go:111] Terraform output is in /tmp/test3418307298/out --- PASS: TestMinimal (8.10s) === RUN TestMinimal_v1_23 I0317 23:14:37.014180 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:37.014374 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:37.014407 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:37.014446 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:37.014476 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:37.014514 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:37.014544 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:37.014565 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:37.014594 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:37.014615 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:37.034628 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0317 23:14:37.037372 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:37.037440 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:38.964440 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:39.095948 32978 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0317 23:14:39.100059 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:14:39.100121 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:14:39.100306 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:14:39.103150 32978 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0317 23:14:39.107630 32978 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0317 23:14:39.107929 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:39.108143 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:39.108308 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:39.108671 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:39.108747 32978 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0317 23:14:39.108934 32978 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0317 23:14:39.109139 32978 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0317 23:14:39.114568 32978 target.go:111] Terraform output is in /tmp/test3449997667/out --- PASS: TestMinimal_v1_23 (2.10s) === RUN TestMinimal_v1_24 I0317 23:14:39.118816 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:39.118997 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:39.119028 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:39.119065 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:39.119094 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:39.119129 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:39.119158 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:39.119181 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:39.119207 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:39.119227 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:39.138863 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:14:39.141467 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:39.141535 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:40.881506 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:40.965581 32978 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0317 23:14:40.966612 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:14:40.966639 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:14:40.966713 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:14:40.968274 32978 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0317 23:14:40.971534 32978 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0317 23:14:40.971919 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:40.972383 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:40.972517 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:40.973697 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:40.973754 32978 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0317 23:14:40.973964 32978 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0317 23:14:40.974172 32978 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0317 23:14:40.977741 32978 target.go:111] Terraform output is in /tmp/test3961316028/out --- PASS: TestMinimal_v1_24 (1.86s) === RUN TestMinimal_v1_25 I0317 23:14:40.980381 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:40.980513 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:40.980534 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:40.980559 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:40.980578 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:40.980602 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:40.980623 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:40.980636 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:40.980656 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:40.980671 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:40.992675 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0317 23:14:40.994264 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:40.994308 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:43.151341 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:43.224411 32978 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0317 23:14:43.225025 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:14:43.225042 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:14:43.225083 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:14:43.228604 32978 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0317 23:14:43.232554 32978 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0317 23:14:43.232963 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:43.233181 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:43.233211 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:43.233448 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:43.233492 32978 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0317 23:14:43.233605 32978 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0317 23:14:43.233738 32978 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0317 23:14:43.237748 32978 target.go:111] Terraform output is in /tmp/test3439501027/out --- PASS: TestMinimal_v1_25 (2.26s) === RUN TestMinimal_v1_26 I0317 23:14:43.240673 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:43.240807 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:43.240837 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:43.240870 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:43.240892 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:43.240922 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:43.240949 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:43.240965 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:43.240988 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:43.241006 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:43.253949 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0317 23:14:43.255113 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:43.255152 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:45.367646 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:45.435141 32978 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0317 23:14:45.436544 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:14:45.436557 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:14:45.436598 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:14:45.437320 32978 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0317 23:14:45.441767 32978 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0317 23:14:45.442008 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:45.442186 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:45.442411 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:45.442459 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:45.442579 32978 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0317 23:14:45.442694 32978 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0317 23:14:45.442858 32978 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0317 23:14:45.446887 32978 target.go:111] Terraform output is in /tmp/test2498971678/out --- PASS: TestMinimal_v1_26 (2.21s) === RUN TestMinimal_v1_27 I0317 23:14:45.449428 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:45.449543 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:45.449565 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:45.449593 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:45.449612 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:45.449638 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:45.449660 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:45.449673 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:45.449692 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:45.449706 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:45.462748 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0317 23:14:45.464430 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:45.464473 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:48.394541 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:48.484717 32978 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0317 23:14:48.485008 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:14:48.485030 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:14:48.485094 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:14:48.490011 32978 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0317 23:14:48.493401 32978 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0317 23:14:48.494047 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:48.494361 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:48.494391 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:48.494523 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:48.494559 32978 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0317 23:14:48.494686 32978 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0317 23:14:48.494811 32978 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0317 23:14:48.497396 32978 target.go:111] Terraform output is in /tmp/test2190209884/out --- PASS: TestMinimal_v1_27 (3.05s) === RUN TestMinimal_NoneDNS I0317 23:14:48.499487 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:48.499600 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:48.499625 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:48.499658 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:48.499678 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:48.499709 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:48.499732 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:48.499748 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:48.499773 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:48.499788 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0317 23:14:48.511467 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:48.511516 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:49.837743 32978 executor.go:111] Tasks: 0 done / 110 total; 43 can run I0317 23:14:49.840175 32978 executor.go:111] Tasks: 43 done / 110 total; 24 can run I0317 23:14:49.842007 32978 executor.go:111] Tasks: 67 done / 110 total; 29 can run I0317 23:14:49.842362 32978 executor.go:111] Tasks: 96 done / 110 total; 2 can run I0317 23:14:49.842401 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:14:49.842438 32978 loadbalancers.go:35] PageSize not implemented I0317 23:14:49.842532 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:14:49.842602 32978 loadbalancers.go:35] PageSize not implemented I0317 23:14:49.844936 32978 executor.go:111] Tasks: 98 done / 110 total; 4 can run I0317 23:14:49.845016 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:49.845141 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:49.845292 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:49.845334 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:49.845373 32978 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0317 23:14:49.845497 32978 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0317 23:14:49.845612 32978 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0317 23:14:49.848859 32978 target.go:111] Terraform output is in /tmp/test2385451975/out --- PASS: TestMinimal_NoneDNS (1.35s) === RUN TestHetzner I0317 23:14:49.850765 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:14:51.422266 32978 executor.go:111] Tasks: 0 done / 46 total; 37 can run I0317 23:14:51.429673 32978 executor.go:111] Tasks: 37 done / 46 total; 3 can run I0317 23:14:51.429992 32978 executor.go:111] Tasks: 40 done / 46 total; 2 can run I0317 23:14:51.434087 32978 executor.go:111] Tasks: 42 done / 46 total; 4 can run I0317 23:14:51.435199 32978 executor.go:111] Tasks: 46 done / 46 total; 0 can run I0317 23:14:51.439167 32978 target.go:111] Terraform output is in /tmp/test293087121/out --- PASS: TestHetzner (1.59s) === RUN TestNvidia I0317 23:14:51.443510 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:51.443793 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:51.443844 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:51.443902 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:51.443955 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:51.444011 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:51.444060 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:51.444096 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:51.444142 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:51.444175 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:51.463991 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:14:51.466495 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:51.466558 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:53.103293 32978 zones.go:93] ListHostedZonesPages { } I0317 23:14:53.199725 32978 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0317 23:14:53.200134 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:14:53.200146 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:14:53.200182 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:14:53.205414 32978 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0317 23:14:53.209847 32978 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0317 23:14:53.210175 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:53.210310 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:53.210474 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:53.210624 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:53.210702 32978 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0317 23:14:53.210871 32978 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0317 23:14:53.211043 32978 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0317 23:14:53.216704 32978 target.go:111] Terraform output is in /tmp/test2346806779/out --- PASS: TestNvidia (1.78s) === RUN TestMinimalGossip I0317 23:14:53.221223 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:53.221425 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:53.221461 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:53.221514 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:53.221546 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:53.221602 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:53.221635 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:53.221656 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:53.221703 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:53.221725 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:14:53.242408 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:53.242479 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:54.583130 32978 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0317 23:14:54.588366 32978 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0317 23:14:54.592854 32978 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0317 23:14:54.593124 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:54.593269 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:54.593366 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:54.593468 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:54.593508 32978 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0317 23:14:54.593637 32978 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0317 23:14:54.593792 32978 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0317 23:14:54.598655 32978 target.go:111] Terraform output is in /tmp/test781498277/out --- PASS: TestMinimalGossip (1.38s) === RUN TestMinimalGossipIRSA I0317 23:14:54.602699 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:54.602864 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:54.602893 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:54.602926 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:54.602957 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:54.602990 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:54.603019 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:54.603037 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:54.603062 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:54.603081 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:14:54.622941 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:54.622997 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:56.011344 32978 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0317 23:14:56.014242 32978 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0317 23:14:56.018721 32978 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0317 23:14:56.019022 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:56.019206 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:56.019360 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:56.019510 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:14:56.019585 32978 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0317 23:14:56.019750 32978 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0317 23:14:56.019944 32978 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0317 23:14:56.025613 32978 target.go:111] Terraform output is in /tmp/test161728163/out --- PASS: TestMinimalGossipIRSA (1.43s) === RUN TestMinimalGCE I0317 23:14:56.033387 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:56.034947 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:14:58.085443 32978 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0317 23:14:58.085516 32978 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0317 23:14:58.085600 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0317 23:14:58.085620 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0317 23:14:58.085639 32978 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0317 23:14:58.085685 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0317 23:14:58.086630 32978 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0317 23:14:58.090251 32978 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0317 23:14:58.094450 32978 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0317 23:14:58.095177 32978 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0317 23:14:58.095312 32978 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0317 23:14:58.098533 32978 target.go:111] Terraform output is in /tmp/test200590116/out --- PASS: TestMinimalGCE (2.07s) === RUN TestMinimalGCEPrivate I0317 23:14:58.104253 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:58.105697 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:14:59.705661 32978 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0317 23:14:59.705739 32978 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0317 23:14:59.705842 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W0317 23:14:59.705867 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W0317 23:14:59.705887 32978 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W0317 23:14:59.705941 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0317 23:14:59.707127 32978 executor.go:111] Tasks: 0 done / 65 total; 41 can run I0317 23:14:59.709933 32978 executor.go:111] Tasks: 41 done / 65 total; 17 can run I0317 23:14:59.714252 32978 executor.go:111] Tasks: 58 done / 65 total; 5 can run I0317 23:14:59.715071 32978 executor.go:111] Tasks: 63 done / 65 total; 2 can run I0317 23:14:59.715249 32978 executor.go:111] Tasks: 65 done / 65 total; 0 can run I0317 23:14:59.718864 32978 target.go:111] Terraform output is in /tmp/test3458371495/out --- PASS: TestMinimalGCEPrivate (1.62s) === RUN TestMinimalGCEInternalLoadBalancer I0317 23:14:59.722185 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:59.723745 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:15:01.332918 32978 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0317 23:15:01.332986 32978 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0317 23:15:01.333091 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W0317 23:15:01.333110 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W0317 23:15:01.333128 32978 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W0317 23:15:01.333181 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0317 23:15:01.333217 32978 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0317 23:15:01.334367 32978 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0317 23:15:01.337070 32978 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0317 23:15:01.337490 32978 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0317 23:15:01.337724 32978 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0317 23:15:01.341863 32978 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0317 23:15:01.342590 32978 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0317 23:15:01.342754 32978 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0317 23:15:01.342976 32978 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0317 23:15:01.343190 32978 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0317 23:15:01.347028 32978 target.go:111] Terraform output is in /tmp/test3672175837/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.63s) === RUN TestMinimalGCEPublicLoadBalancer I0317 23:15:01.350421 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:01.351952 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:15:02.970664 32978 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0317 23:15:02.970716 32978 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0317 23:15:02.970809 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W0317 23:15:02.970827 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W0317 23:15:02.970841 32978 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W0317 23:15:02.970881 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0317 23:15:02.971799 32978 executor.go:111] Tasks: 0 done / 71 total; 43 can run I0317 23:15:02.979319 32978 executor.go:111] Tasks: 43 done / 71 total; 19 can run I0317 23:15:02.984074 32978 executor.go:111] Tasks: 62 done / 71 total; 7 can run I0317 23:15:02.984845 32978 executor.go:111] Tasks: 69 done / 71 total; 2 can run I0317 23:15:02.984985 32978 executor.go:111] Tasks: 71 done / 71 total; 0 can run I0317 23:15:02.988687 32978 target.go:111] Terraform output is in /tmp/test2896341906/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.64s) === RUN TestMinimalGCELongClusterName I0317 23:15:02.992086 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:02.993567 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:15:04.584217 32978 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0317 23:15:04.584322 32978 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0317 23:15:04.584436 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0317 23:15:04.584455 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0317 23:15:04.584477 32978 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0317 23:15:04.584533 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0317 23:15:04.585580 32978 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0317 23:15:04.589662 32978 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0317 23:15:04.596499 32978 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0317 23:15:04.597387 32978 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0317 23:15:04.597676 32978 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0317 23:15:04.601081 32978 target.go:111] Terraform output is in /tmp/test1030086766/out --- PASS: TestMinimalGCELongClusterName (1.61s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I0317 23:15:04.604227 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:04.605672 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:15:06.213705 32978 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0317 23:15:06.213763 32978 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0317 23:15:06.213876 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0317 23:15:06.213906 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0317 23:15:06.213923 32978 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0317 23:15:06.213964 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0317 23:15:06.213997 32978 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0317 23:15:06.214879 32978 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0317 23:15:06.221239 32978 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0317 23:15:06.221675 32978 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0317 23:15:06.221909 32978 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0317 23:15:06.226263 32978 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0317 23:15:06.227195 32978 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0317 23:15:06.227380 32978 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0317 23:15:06.227514 32978 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0317 23:15:06.227635 32978 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0317 23:15:06.231405 32978 target.go:111] Terraform output is in /tmp/test4222502494/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.63s) === RUN TestMinimalGCEDNSNone I0317 23:15:06.234851 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:06.236351 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:15:07.865944 32978 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0317 23:15:07.866089 32978 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0317 23:15:07.866623 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0317 23:15:07.867033 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0317 23:15:07.867067 32978 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0317 23:15:07.867139 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0317 23:15:07.867181 32978 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0317 23:15:07.868374 32978 executor.go:111] Tasks: 0 done / 72 total; 41 can run I0317 23:15:07.872089 32978 executor.go:111] Tasks: 41 done / 72 total; 18 can run I0317 23:15:07.872469 32978 executor.go:111] Tasks: 59 done / 72 total; 2 can run I0317 23:15:07.872652 32978 executor.go:111] Tasks: 61 done / 72 total; 2 can run I0317 23:15:07.876715 32978 executor.go:111] Tasks: 63 done / 72 total; 4 can run I0317 23:15:07.877424 32978 executor.go:111] Tasks: 67 done / 72 total; 2 can run I0317 23:15:07.877579 32978 executor.go:111] Tasks: 69 done / 72 total; 1 can run I0317 23:15:07.877699 32978 executor.go:111] Tasks: 70 done / 72 total; 2 can run I0317 23:15:07.877849 32978 executor.go:111] Tasks: 72 done / 72 total; 0 can run I0317 23:15:07.881598 32978 target.go:111] Terraform output is in /tmp/test873772694/out --- PASS: TestMinimalGCEDNSNone (1.65s) === RUN TestMinimalScaleway I0317 23:15:07.884827 32978 featureflag.go:164] FeatureFlag "Scaleway"=true I0317 23:15:07.884844 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:15:09.713328 32978 executor.go:111] Tasks: 0 done / 49 total; 37 can run I0317 23:15:09.721721 32978 executor.go:111] Tasks: 37 done / 49 total; 6 can run I0317 23:15:09.725979 32978 executor.go:111] Tasks: 43 done / 49 total; 6 can run I0317 23:15:09.726932 32978 executor.go:111] Tasks: 49 done / 49 total; 0 can run I0317 23:15:09.730109 32978 target.go:111] Terraform output is in /tmp/test2505272182/out I0317 23:15:09.733519 32978 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (1.85s) === RUN TestHA I0317 23:15:09.733636 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:09.733839 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:09.733877 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:09.733920 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:09.733951 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:09.733990 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:09.734022 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:09.734044 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:09.734072 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:09.734094 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:09.759033 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:09.761916 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:09.761985 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:09.762023 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:09.762060 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:11.005543 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:11.154702 32978 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0317 23:15:11.156987 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:11.157023 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:11.157136 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:11.159422 32978 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0317 23:15:11.164002 32978 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0317 23:15:11.164187 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:11.164416 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:11.165459 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:11.165621 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:11.166114 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:11.166240 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:11.166318 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:11.166621 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:11.166825 32978 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0317 23:15:11.167909 32978 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0317 23:15:11.169970 32978 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0317 23:15:11.177830 32978 target.go:111] Terraform output is in /tmp/test771917608/out --- PASS: TestHA (1.45s) === RUN TestHighAvailabilityGCE I0317 23:15:11.183305 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:11.184914 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:15:12.797175 32978 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0317 23:15:12.797246 32978 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0317 23:15:12.797357 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W0317 23:15:12.797377 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W0317 23:15:12.797396 32978 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W0317 23:15:12.797444 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0317 23:15:12.797501 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0317 23:15:12.797552 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0317 23:15:12.799395 32978 executor.go:111] Tasks: 0 done / 82 total; 49 can run I0317 23:15:12.802889 32978 executor.go:111] Tasks: 49 done / 82 total; 19 can run I0317 23:15:12.807354 32978 executor.go:111] Tasks: 68 done / 82 total; 8 can run I0317 23:15:12.808376 32978 executor.go:111] Tasks: 76 done / 82 total; 6 can run I0317 23:15:12.808573 32978 executor.go:111] Tasks: 82 done / 82 total; 0 can run I0317 23:15:12.813231 32978 target.go:111] Terraform output is in /tmp/test4140511682/out --- PASS: TestHighAvailabilityGCE (1.63s) === RUN TestComplex I0317 23:15:12.817694 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:12.817932 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:12.817980 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:12.818081 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:12.818131 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:12.818182 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:12.818232 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:12.818261 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:12.818297 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:12.818334 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:12.847018 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:15:12.850690 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:12.850766 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:14.653754 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:14.803367 32978 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0317 23:15:14.805727 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:14.805798 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:14.805942 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:14.810496 32978 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0317 23:15:14.813146 32978 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0317 23:15:14.813770 32978 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0317 23:15:14.814012 32978 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0317 23:15:14.814075 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:14.814156 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:14.814264 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:14.814336 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:14.818737 32978 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0317 23:15:14.818941 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:14.819133 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:14.819341 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:14.819742 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:14.819823 32978 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0317 23:15:14.820035 32978 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0317 23:15:14.820274 32978 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0317 23:15:14.826640 32978 target.go:111] Terraform output is in /tmp/test2544323317/out I0317 23:15:14.831137 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:14.831314 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:14.831347 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:14.831383 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:14.831414 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:14.831449 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:14.831480 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:14.831500 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:14.831527 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:14.831547 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:14.856387 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:15:14.859461 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:14.859520 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:16.156256 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:16.312228 32978 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0317 23:15:16.313261 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:16.313305 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:16.313433 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:16.316229 32978 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0317 23:15:16.322943 32978 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0317 23:15:16.324549 32978 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0317 23:15:16.324712 32978 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0317 23:15:16.324756 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:16.324807 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:16.324913 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:16.324987 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:16.329624 32978 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0317 23:15:16.329794 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:16.329979 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:16.330251 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:16.330639 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:16.330740 32978 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0317 23:15:16.331008 32978 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0317 23:15:16.331220 32978 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0317 23:15:16.337459 32978 target.go:111] Terraform output is in /tmp/test2407447336/out --- PASS: TestComplex (3.52s) === RUN TestCompress I0317 23:15:16.341905 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:16.342110 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:16.342141 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:16.342177 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:16.342206 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:16.342240 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:16.342271 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:16.342291 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:16.342318 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:16.342338 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:16.360133 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:16.362516 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:16.362577 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:17.584874 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:17.791589 32978 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0317 23:15:17.793039 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:17.793064 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:17.793138 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:17.795530 32978 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0317 23:15:17.800404 32978 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0317 23:15:17.800689 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:17.800933 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:17.801907 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:17.802294 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:17.802388 32978 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0317 23:15:17.802645 32978 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0317 23:15:17.802835 32978 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0317 23:15:17.808079 32978 target.go:111] Terraform output is in /tmp/test3277555548/out --- PASS: TestCompress (1.47s) === RUN TestExternalPolicies I0317 23:15:17.812455 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:17.812658 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:17.812695 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:17.812732 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:17.812762 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:17.812803 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:17.812838 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:17.812859 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:17.812887 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:17.812911 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:17.838175 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:17.841420 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:17.841486 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:19.085363 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:19.222809 32978 executor.go:111] Tasks: 0 done / 115 total; 47 can run I0317 23:15:19.223602 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:19.223634 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:19.223727 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:19.228223 32978 executor.go:111] Tasks: 47 done / 115 total; 22 can run I0317 23:15:19.232766 32978 executor.go:111] Tasks: 69 done / 115 total; 30 can run I0317 23:15:19.233292 32978 executor.go:111] Tasks: 99 done / 115 total; 4 can run W0317 23:15:19.233333 32978 api.go:53] PageSize not implemented W0317 23:15:19.233382 32978 api.go:53] PageSize not implemented I0317 23:15:19.238145 32978 executor.go:111] Tasks: 103 done / 115 total; 4 can run I0317 23:15:19.238322 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:19.238541 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:19.238924 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:19.238981 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:19.239068 32978 executor.go:111] Tasks: 107 done / 115 total; 2 can run I0317 23:15:19.239329 32978 executor.go:111] Tasks: 109 done / 115 total; 6 can run I0317 23:15:19.239548 32978 executor.go:111] Tasks: 115 done / 115 total; 0 can run I0317 23:15:19.245480 32978 target.go:111] Terraform output is in /tmp/test3672294543/out --- PASS: TestExternalPolicies (1.44s) === RUN TestMinimalIPv6 I0317 23:15:19.250056 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:19.250284 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:19.250321 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:19.250362 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:19.250393 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:19.250432 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:19.250466 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:19.250489 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:19.250519 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:19.250541 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:19.273231 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:15:19.276249 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:19.276313 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:20.568705 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:20.694445 32978 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0317 23:15:20.695876 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:20.695906 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:20.695988 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:20.697290 32978 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0317 23:15:20.700043 32978 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0317 23:15:20.700721 32978 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0317 23:15:20.701028 32978 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0317 23:15:20.701089 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:20.701147 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:20.701188 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:20.701270 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:20.705282 32978 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0317 23:15:20.705483 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:20.705721 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:20.706019 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:20.706361 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:20.706471 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:15:20.706773 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:15:20.707026 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0317 23:15:20.712738 32978 target.go:111] Terraform output is in /tmp/test1622722665/out --- PASS: TestMinimalIPv6 (1.47s) === RUN TestMinimalIPv6Calico I0317 23:15:20.717187 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:20.717370 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:20.717401 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:20.717436 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:20.717465 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:20.717501 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:20.717532 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:20.717553 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:20.717581 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:20.717601 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:20.742626 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:15:20.745610 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:20.745677 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:21.979011 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:22.314202 32978 executor.go:111] Tasks: 0 done / 138 total; 47 can run I0317 23:15:22.314849 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:22.314879 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:22.314954 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:22.316996 32978 executor.go:111] Tasks: 47 done / 138 total; 25 can run I0317 23:15:22.319687 32978 executor.go:111] Tasks: 72 done / 138 total; 37 can run I0317 23:15:22.320391 32978 executor.go:111] Tasks: 109 done / 138 total; 9 can run I0317 23:15:22.320652 32978 executor.go:111] Tasks: 118 done / 138 total; 8 can run I0317 23:15:22.320726 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:22.320792 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:22.320887 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:22.320950 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:22.325191 32978 executor.go:111] Tasks: 126 done / 138 total; 4 can run I0317 23:15:22.325350 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:22.325466 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:22.325885 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:22.325951 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:22.326029 32978 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0317 23:15:22.326270 32978 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0317 23:15:22.326504 32978 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0317 23:15:22.333087 32978 target.go:111] Terraform output is in /tmp/test2737476586/out --- PASS: TestMinimalIPv6Calico (1.62s) === RUN TestMinimalIPv6Cilium I0317 23:15:22.338177 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:22.338362 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:22.338393 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:22.338439 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:22.338468 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:22.338507 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:22.338539 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:22.338559 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:22.338587 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:22.338608 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:22.364729 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:15:22.367967 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:22.368041 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:23.606244 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:23.767905 32978 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0317 23:15:23.768752 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:23.768780 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:23.768848 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:23.775238 32978 executor.go:111] Tasks: 47 done / 137 total; 25 can run I0317 23:15:23.777897 32978 executor.go:111] Tasks: 72 done / 137 total; 36 can run I0317 23:15:23.778524 32978 executor.go:111] Tasks: 108 done / 137 total; 9 can run I0317 23:15:23.778816 32978 executor.go:111] Tasks: 117 done / 137 total; 8 can run I0317 23:15:23.778896 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:23.778955 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:23.779044 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:23.779100 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:23.783223 32978 executor.go:111] Tasks: 125 done / 137 total; 4 can run I0317 23:15:23.783346 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:23.783478 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:23.783818 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:23.783905 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:23.783979 32978 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0317 23:15:23.784197 32978 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0317 23:15:23.784432 32978 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0317 23:15:23.790995 32978 target.go:111] Terraform output is in /tmp/test618783643/out --- PASS: TestMinimalIPv6Cilium (1.46s) === RUN TestMinimalIPv6NoSubnetPrefix I0317 23:15:23.795744 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:23.795923 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:23.795955 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:23.795990 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:23.796018 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:23.796060 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:23.796091 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:23.796112 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:23.796138 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:23.796157 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:23.818816 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:15:23.821888 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:23.821950 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:25.036839 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:25.180899 32978 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0317 23:15:25.182716 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:25.182753 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:25.183046 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:25.187646 32978 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0317 23:15:25.190149 32978 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0317 23:15:25.190810 32978 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0317 23:15:25.191038 32978 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0317 23:15:25.191149 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:25.191212 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:25.191326 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:15:25.191382 32978 loadbalancers.go:35] PageSize not implemented I0317 23:15:25.195410 32978 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0317 23:15:25.195573 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:25.195751 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:25.196117 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:25.196188 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:25.196251 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:15:25.196465 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:15:25.196725 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0317 23:15:25.203532 32978 target.go:111] Terraform output is in /tmp/test3865849766/out --- PASS: TestMinimalIPv6NoSubnetPrefix (1.41s) === RUN TestMinimalWarmPool I0317 23:15:25.208282 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:25.208501 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:25.208538 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:25.208580 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:25.208611 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:25.208652 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:25.208689 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:25.208712 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:25.208742 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:25.208764 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:25.228408 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:25.231277 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:25.231344 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:26.463585 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:26.640740 32978 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0317 23:15:26.641324 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:26.641363 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:26.641447 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:26.645037 32978 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0317 23:15:26.650505 32978 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0317 23:15:26.650923 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:26.651118 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:26.651475 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:26.651535 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:26.651603 32978 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0317 23:15:26.651855 32978 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0317 23:15:26.652112 32978 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0317 23:15:26.657945 32978 target.go:111] Terraform output is in /tmp/test1227593675/out --- PASS: TestMinimalWarmPool (1.46s) === RUN TestMinimalEtcd I0317 23:15:26.664895 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:26.665632 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:26.665738 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:26.665791 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:26.665827 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:26.665864 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:26.665902 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:26.665924 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:26.665956 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:26.665986 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:26.686818 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:26.689364 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:26.689426 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:27.900137 32978 zones.go:93] ListHostedZonesPages { } W0317 23:15:28.028248 32978 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W0317 23:15:28.028292 32978 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W0317 23:15:28.030473 32978 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I0317 23:15:28.039944 32978 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0317 23:15:28.040749 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:28.040774 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:28.040847 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:28.042671 32978 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0317 23:15:28.046873 32978 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0317 23:15:28.047091 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:28.047367 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:28.047624 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:28.047694 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:28.047753 32978 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0317 23:15:28.047959 32978 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0317 23:15:28.048220 32978 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0317 23:15:28.053843 32978 target.go:111] Terraform output is in /tmp/test3912505461/out --- PASS: TestMinimalEtcd (1.40s) === RUN TestMinimalGp3 I0317 23:15:28.061344 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:28.061552 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:28.061598 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:28.061640 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:28.061671 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:28.061706 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:28.061740 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:28.061763 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:28.061790 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:28.061813 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:28.081342 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:28.083889 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:28.083951 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:29.350915 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:29.486503 32978 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0317 23:15:29.487580 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:29.487613 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:29.487698 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:29.490457 32978 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0317 23:15:29.494938 32978 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0317 23:15:29.495122 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:29.495465 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:29.495664 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:29.496031 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:29.496123 32978 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0317 23:15:29.496383 32978 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0317 23:15:29.496593 32978 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0317 23:15:29.502037 32978 target.go:111] Terraform output is in /tmp/test4070131549/out --- PASS: TestMinimalGp3 (1.45s) === RUN TestMinimalLongClusterName I0317 23:15:29.507243 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:29.507416 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:29.507461 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:29.507497 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:29.507532 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:29.507582 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:29.507620 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:29.507641 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:29.507791 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:29.507883 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:29.527864 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:29.530196 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:29.530257 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0317 23:15:30.769732 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:30.907040 32978 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0317 23:15:30.908386 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:30.908411 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:30.908480 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:30.911422 32978 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0317 23:15:30.916111 32978 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0317 23:15:30.916305 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:30.916605 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:30.916786 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:30.917177 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:30.917256 32978 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0317 23:15:30.917504 32978 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0317 23:15:30.917756 32978 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0317 23:15:30.923270 32978 target.go:111] Terraform output is in /tmp/test2543291224/out --- PASS: TestMinimalLongClusterName (1.42s) === RUN TestExistingSG I0317 23:15:30.928143 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:30.929322 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:30.929369 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:30.929471 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:30.929515 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:30.929571 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:30.929611 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:30.929643 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:30.929686 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:30.929711 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:30.957178 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:30.959953 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:30.960017 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:30.960055 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:30.960116 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:32.177835 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:32.317413 32978 executor.go:111] Tasks: 0 done / 163 total; 53 can run I0317 23:15:32.318970 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:32.319001 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:32.319076 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:32.320475 32978 executor.go:111] Tasks: 53 done / 163 total; 26 can run I0317 23:15:32.326845 32978 executor.go:111] Tasks: 79 done / 163 total; 54 can run I0317 23:15:32.329860 32978 executor.go:111] Tasks: 133 done / 163 total; 6 can run W0317 23:15:32.329930 32978 api.go:53] PageSize not implemented W0317 23:15:32.329967 32978 api.go:53] PageSize not implemented W0317 23:15:32.330053 32978 api.go:53] PageSize not implemented W0317 23:15:32.330102 32978 api.go:53] PageSize not implemented I0317 23:15:32.334517 32978 executor.go:111] Tasks: 139 done / 163 total; 8 can run I0317 23:15:32.334675 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:32.334830 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:32.335063 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:32.335230 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:32.335294 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:32.335451 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:32.335542 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:32.335771 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:32.335846 32978 executor.go:111] Tasks: 147 done / 163 total; 4 can run I0317 23:15:32.336152 32978 executor.go:111] Tasks: 151 done / 163 total; 12 can run I0317 23:15:32.336487 32978 executor.go:111] Tasks: 163 done / 163 total; 0 can run I0317 23:15:32.344440 32978 target.go:111] Terraform output is in /tmp/test3927466129/out --- PASS: TestExistingSG (1.42s) === RUN TestBastionAdditionalUserData I0317 23:15:32.349999 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:32.350221 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:32.350259 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:32.350309 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:32.350342 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:32.350380 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:32.350415 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:32.350436 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:32.350464 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:32.350486 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:32.371922 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:32.374678 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:32.374741 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:32.374783 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:33.627441 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:33.766326 32978 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0317 23:15:33.766900 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:33.766929 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:33.767004 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:33.769328 32978 executor.go:111] Tasks: 47 done / 137 total; 30 can run I0317 23:15:33.771879 32978 executor.go:111] Tasks: 77 done / 137 total; 35 can run I0317 23:15:33.772577 32978 executor.go:111] Tasks: 112 done / 137 total; 6 can run W0317 23:15:33.772633 32978 api.go:53] PageSize not implemented W0317 23:15:33.772691 32978 api.go:53] PageSize not implemented W0317 23:15:33.772742 32978 api.go:53] PageSize not implemented I0317 23:15:33.776986 32978 executor.go:111] Tasks: 118 done / 137 total; 7 can run I0317 23:15:33.777133 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:33.777353 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:33.777546 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:33.777743 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:33.777814 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:33.778182 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:33.778270 32978 executor.go:111] Tasks: 125 done / 137 total; 3 can run I0317 23:15:33.778568 32978 executor.go:111] Tasks: 128 done / 137 total; 9 can run I0317 23:15:33.778856 32978 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0317 23:15:33.785454 32978 target.go:111] Terraform output is in /tmp/test3903485941/out --- PASS: TestBastionAdditionalUserData (1.44s) === RUN TestPrivateFlannel I0317 23:15:33.790378 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:33.790563 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:33.790595 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:33.790634 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:33.790664 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:33.790702 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:33.790735 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:33.790757 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:33.790785 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:33.790807 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:33.813988 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:15:33.816509 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:33.816573 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:33.816614 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:35.025397 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:35.183974 32978 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0317 23:15:35.185318 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:35.185343 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:35.185414 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:35.186257 32978 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0317 23:15:35.188825 32978 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0317 23:15:35.189324 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:35.189432 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:35.189505 32978 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0317 23:15:35.189578 32978 api.go:53] PageSize not implemented W0317 23:15:35.189616 32978 api.go:53] PageSize not implemented I0317 23:15:35.193746 32978 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0317 23:15:35.193939 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:35.194124 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:35.194468 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:35.194598 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:35.194726 32978 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0317 23:15:35.195960 32978 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0317 23:15:35.196806 32978 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0317 23:15:35.206422 32978 target.go:111] Terraform output is in /tmp/test1364496041/out --- PASS: TestPrivateFlannel (1.42s) === RUN TestPrivateCalico I0317 23:15:35.211520 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:35.211722 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:35.211757 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:35.211796 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:35.211827 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:35.211867 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:35.211900 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:35.211922 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:35.211949 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:35.211972 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:35.233917 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:15:35.236718 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:35.236811 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:35.236854 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:36.499187 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:36.818681 32978 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0317 23:15:36.819508 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:36.819542 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:36.819626 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:36.821431 32978 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0317 23:15:36.824168 32978 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0317 23:15:36.824620 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:36.824742 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:36.824911 32978 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0317 23:15:36.825019 32978 api.go:53] PageSize not implemented W0317 23:15:36.825114 32978 api.go:53] PageSize not implemented I0317 23:15:36.829179 32978 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0317 23:15:36.829412 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:36.829623 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:36.829995 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:36.830104 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:36.830230 32978 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0317 23:15:36.830481 32978 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0317 23:15:36.830731 32978 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0317 23:15:36.837987 32978 target.go:111] Terraform output is in /tmp/test2527481269/out --- PASS: TestPrivateCalico (1.63s) === RUN TestPrivateCilium I0317 23:15:36.843667 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:36.843874 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:36.843912 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:36.843950 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:36.843981 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:36.844020 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:36.844054 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:36.844076 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:36.844106 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:36.844128 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:36.866311 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:36.869382 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:36.869446 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:36.869487 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:38.088578 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:38.259885 32978 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0317 23:15:38.260940 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:38.260966 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:38.261043 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:38.263790 32978 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0317 23:15:38.266205 32978 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0317 23:15:38.266698 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:38.266856 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:38.266941 32978 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0317 23:15:38.266997 32978 api.go:53] PageSize not implemented W0317 23:15:38.267112 32978 api.go:53] PageSize not implemented I0317 23:15:38.275230 32978 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0317 23:15:38.275443 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:38.275573 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:38.275945 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:38.276016 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:38.276101 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:15:38.276336 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:15:38.276575 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0317 23:15:38.283964 32978 target.go:111] Terraform output is in /tmp/test393390533/out --- PASS: TestPrivateCilium (1.44s) === RUN TestPrivateCilium2 I0317 23:15:38.288715 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:38.288900 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:38.288932 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:38.288970 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:38.289001 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:38.289037 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:38.289104 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:38.289127 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:38.289156 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:38.289177 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:38.310650 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:15:38.313509 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:38.313567 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:38.313606 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:39.525528 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:40.059201 32978 executor.go:111] Tasks: 0 done / 138 total; 50 can run I0317 23:15:40.060453 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:40.060470 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:40.060510 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:40.062028 32978 executor.go:111] Tasks: 50 done / 138 total; 30 can run I0317 23:15:40.064699 32978 executor.go:111] Tasks: 80 done / 138 total; 36 can run I0317 23:15:40.065060 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:40.065742 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:40.067445 32978 executor.go:111] Tasks: 116 done / 138 total; 6 can run W0317 23:15:40.067610 32978 api.go:53] PageSize not implemented W0317 23:15:40.067770 32978 api.go:53] PageSize not implemented I0317 23:15:40.073745 32978 executor.go:111] Tasks: 122 done / 138 total; 8 can run I0317 23:15:40.073960 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:40.074140 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:40.074474 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:40.074539 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:40.074595 32978 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0317 23:15:40.074781 32978 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0317 23:15:40.075026 32978 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0317 23:15:40.083051 32978 target.go:111] Terraform output is in /tmp/test1219883361/out --- PASS: TestPrivateCilium2 (1.80s) === RUN TestPrivateCiliumAdvanced I0317 23:15:40.092650 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:40.092844 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:40.092879 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:40.092920 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:40.092950 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:40.092986 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:40.093020 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:40.093042 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:40.093070 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:40.093090 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:40.118535 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:40.121379 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:40.121440 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:40.121477 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:41.342337 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:41.516175 32978 executor.go:111] Tasks: 0 done / 142 total; 54 can run I0317 23:15:41.516799 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:41.516832 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:41.516909 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:41.523994 32978 executor.go:111] Tasks: 54 done / 142 total; 30 can run I0317 23:15:41.526971 32978 executor.go:111] Tasks: 84 done / 142 total; 36 can run I0317 23:15:41.527202 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:41.527319 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:41.527600 32978 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0317 23:15:41.527649 32978 api.go:53] PageSize not implemented W0317 23:15:41.527673 32978 api.go:53] PageSize not implemented I0317 23:15:41.532671 32978 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0317 23:15:41.532851 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:41.533028 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:41.533192 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:41.533608 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:41.533691 32978 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0317 23:15:41.533889 32978 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0317 23:15:41.534120 32978 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0317 23:15:41.541165 32978 target.go:111] Terraform output is in /tmp/test723985116/out --- PASS: TestPrivateCiliumAdvanced (1.45s) === RUN TestPrivateCiliumENI I0317 23:15:41.546435 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:41.546640 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:41.546676 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:41.546715 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:41.546763 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:41.546804 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:41.546841 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:41.546863 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:41.546894 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:41.546917 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:41.568486 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:41.571357 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:41.571418 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:41.571458 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:42.847649 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:43.025838 32978 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0317 23:15:43.026585 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:43.026622 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:43.026709 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:43.029857 32978 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0317 23:15:43.031829 32978 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0317 23:15:43.032070 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:43.032194 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:43.032295 32978 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0317 23:15:43.032385 32978 api.go:53] PageSize not implemented W0317 23:15:43.032419 32978 api.go:53] PageSize not implemented I0317 23:15:43.036547 32978 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0317 23:15:43.036848 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:43.037110 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:43.037618 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:43.037698 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:43.037811 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:15:43.038131 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:15:43.039208 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0317 23:15:43.049081 32978 target.go:111] Terraform output is in /tmp/test3490631660/out --- PASS: TestPrivateCiliumENI (1.51s) === RUN TestPrivateCanal I0317 23:15:43.054709 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:43.054890 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:43.054923 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:43.054962 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:43.054993 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:43.055028 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:43.055059 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:43.055078 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:43.055106 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:43.055126 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:43.075126 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:15:43.077713 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:43.077774 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:43.077812 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:44.305692 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:44.607339 32978 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0317 23:15:44.610884 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:44.610907 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:44.610958 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:44.612494 32978 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0317 23:15:44.614420 32978 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0317 23:15:44.614689 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:44.614882 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:44.615075 32978 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0317 23:15:44.615141 32978 api.go:53] PageSize not implemented W0317 23:15:44.615206 32978 api.go:53] PageSize not implemented I0317 23:15:44.619626 32978 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0317 23:15:44.619778 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:44.619922 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:44.620179 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:44.620510 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:44.620594 32978 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0317 23:15:44.620844 32978 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0317 23:15:44.621083 32978 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0317 23:15:44.628099 32978 target.go:111] Terraform output is in /tmp/test3963390330/out --- PASS: TestPrivateCanal (1.58s) === RUN TestPrivateKopeio I0317 23:15:44.633728 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:44.633932 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:44.633967 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:44.634004 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:44.634034 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:44.634072 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:44.634105 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:44.634128 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:44.634156 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:44.634177 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:44.661025 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:44.663904 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:44.663973 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:44.664013 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:45.895089 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:46.043446 32978 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0317 23:15:46.048717 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:46.048772 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:46.049390 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:46.051679 32978 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0317 23:15:46.054364 32978 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0317 23:15:46.055199 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:46.055335 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:46.055416 32978 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0317 23:15:46.055500 32978 api.go:53] PageSize not implemented W0317 23:15:46.055565 32978 api.go:53] PageSize not implemented I0317 23:15:46.059858 32978 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0317 23:15:46.060018 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:46.060142 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:46.060419 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:46.060741 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:46.060835 32978 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0317 23:15:46.061074 32978 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0317 23:15:46.061333 32978 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0317 23:15:46.068130 32978 target.go:111] Terraform output is in /tmp/test924685053/out --- PASS: TestPrivateKopeio (1.44s) === RUN TestUnmanaged I0317 23:15:46.073099 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:46.073305 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:46.073342 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:46.073382 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:46.073447 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:46.073489 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:46.073524 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:46.073544 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:46.073573 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:46.073595 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:46.096578 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:46.099511 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:46.099574 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:46.099617 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:47.357944 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:47.498779 32978 executor.go:111] Tasks: 0 done / 126 total; 46 can run I0317 23:15:47.499702 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:47.499730 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:47.499795 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:47.505431 32978 executor.go:111] Tasks: 46 done / 126 total; 27 can run I0317 23:15:47.508754 32978 executor.go:111] Tasks: 73 done / 126 total; 33 can run I0317 23:15:47.509268 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:47.509385 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:47.509681 32978 executor.go:111] Tasks: 106 done / 126 total; 5 can run W0317 23:15:47.509732 32978 api.go:53] PageSize not implemented W0317 23:15:47.509783 32978 api.go:53] PageSize not implemented I0317 23:15:47.514266 32978 executor.go:111] Tasks: 111 done / 126 total; 7 can run I0317 23:15:47.514408 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:47.514548 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:47.514827 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:47.515197 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:47.515284 32978 executor.go:111] Tasks: 118 done / 126 total; 2 can run I0317 23:15:47.515562 32978 executor.go:111] Tasks: 120 done / 126 total; 6 can run I0317 23:15:47.515749 32978 executor.go:111] Tasks: 126 done / 126 total; 0 can run I0317 23:15:47.521843 32978 target.go:111] Terraform output is in /tmp/test3284446509/out --- PASS: TestUnmanaged (1.45s) === RUN TestPrivateSharedSubnet I0317 23:15:47.526389 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:47.526574 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:47.526605 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:47.526638 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:47.526667 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:47.526702 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:47.526753 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:47.526775 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:47.526803 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:47.526827 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:47.547742 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:47.550818 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:47.550878 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:47.550920 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:48.807058 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:48.950454 32978 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0317 23:15:48.951277 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:48.951315 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:48.951423 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:48.954930 32978 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0317 23:15:48.957502 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:15:48.959751 32978 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0317 23:15:48.960587 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:48.960738 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:48.960821 32978 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0317 23:15:48.960864 32978 api.go:53] PageSize not implemented W0317 23:15:48.960992 32978 api.go:53] PageSize not implemented I0317 23:15:48.965352 32978 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0317 23:15:48.965486 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:48.965690 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:48.966045 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:48.966108 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:48.966178 32978 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0317 23:15:48.966410 32978 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0317 23:15:48.966634 32978 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0317 23:15:48.973347 32978 target.go:111] Terraform output is in /tmp/test1316160482/out --- PASS: TestPrivateSharedSubnet (1.45s) === RUN TestPrivateSharedIP I0317 23:15:48.977925 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:48.978111 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:48.978143 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:48.978181 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:48.978219 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:48.978262 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:48.978294 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:48.978312 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:48.978337 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:48.978358 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:48.998839 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:49.001428 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:49.001486 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:49.001526 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:50.225632 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:50.341305 32978 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0317 23:15:50.342219 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:50.342249 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:50.342336 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:50.344473 32978 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0317 23:15:50.344649 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:15:50.346986 32978 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0317 23:15:50.347368 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:50.347440 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:50.347490 32978 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0317 23:15:50.347522 32978 api.go:53] PageSize not implemented W0317 23:15:50.347611 32978 api.go:53] PageSize not implemented I0317 23:15:50.351726 32978 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0317 23:15:50.351909 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:50.352016 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:50.352286 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:50.352598 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:50.352687 32978 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0317 23:15:50.352939 32978 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0317 23:15:50.353195 32978 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0317 23:15:50.360128 32978 target.go:111] Terraform output is in /tmp/test379077698/out --- PASS: TestPrivateSharedIP (1.39s) === RUN TestPrivateDns1 I0317 23:15:50.364992 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:50.365200 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:50.365234 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:50.365274 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:50.365305 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:50.365346 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:50.365380 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:50.365403 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:50.365435 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:50.365457 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0317 23:15:50.394028 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:50.394095 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:50.394134 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:51.820198 32978 executor.go:111] Tasks: 0 done / 135 total; 46 can run I0317 23:15:51.823504 32978 executor.go:111] Tasks: 46 done / 135 total; 28 can run I0317 23:15:51.823888 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I0317 23:15:51.823931 32978 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I0317 23:15:51.824014 32978 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I0317 23:15:51.824029 32978 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I0317 23:15:51.824100 32978 executor.go:111] Tasks: 74 done / 135 total; 39 can run I0317 23:15:51.824295 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:51.824421 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:51.826651 32978 executor.go:111] Tasks: 113 done / 135 total; 6 can run W0317 23:15:51.826719 32978 api.go:53] PageSize not implemented W0317 23:15:51.826813 32978 api.go:53] PageSize not implemented I0317 23:15:51.831084 32978 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0317 23:15:51.831340 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:51.831461 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:51.831731 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:51.831985 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:51.832073 32978 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0317 23:15:51.832264 32978 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0317 23:15:51.832518 32978 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0317 23:15:51.843830 32978 target.go:111] Terraform output is in /tmp/test1402740388/out --- PASS: TestPrivateDns1 (1.48s) === RUN TestPrivateDns2 I0317 23:15:51.849011 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:51.849200 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:51.849232 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:51.849273 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:51.849313 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:51.849350 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:51.849381 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:51.849401 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:51.849430 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:51.849451 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:51.872476 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:51.872538 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:51.872577 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:53.293742 32978 executor.go:111] Tasks: 0 done / 132 total; 45 can run I0317 23:15:53.296480 32978 executor.go:111] Tasks: 45 done / 132 total; 26 can run I0317 23:15:53.296938 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I0317 23:15:53.296926 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:15:53.296976 32978 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I0317 23:15:53.297049 32978 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I0317 23:15:53.297065 32978 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I0317 23:15:53.297139 32978 executor.go:111] Tasks: 71 done / 132 total; 39 can run I0317 23:15:53.297481 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:53.297592 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:53.300052 32978 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0317 23:15:53.300160 32978 api.go:53] PageSize not implemented W0317 23:15:53.300205 32978 api.go:53] PageSize not implemented I0317 23:15:53.304060 32978 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0317 23:15:53.304213 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:53.304427 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:53.304555 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:53.306666 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:53.306866 32978 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0317 23:15:53.307508 32978 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0317 23:15:53.308598 32978 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0317 23:15:53.316245 32978 target.go:111] Terraform output is in /tmp/test3021775566/out --- PASS: TestPrivateDns2 (1.47s) === RUN TestDiscoveryFeatureGate I0317 23:15:53.321372 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:53.321573 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:53.321608 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:53.321648 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:53.321679 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:53.321717 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:53.321791 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:53.321815 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:53.321842 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:53.321864 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:53.341248 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:15:53.343911 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:53.343977 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:54.596590 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:54.760403 32978 executor.go:111] Tasks: 0 done / 113 total; 52 can run I0317 23:15:54.762844 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:54.762873 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:54.762946 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:54.764993 32978 executor.go:111] Tasks: 52 done / 113 total; 28 can run I0317 23:15:54.769601 32978 executor.go:111] Tasks: 80 done / 113 total; 25 can run I0317 23:15:54.769891 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:54.770097 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:54.770239 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:54.770611 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:54.770698 32978 executor.go:111] Tasks: 105 done / 113 total; 2 can run I0317 23:15:54.770913 32978 executor.go:111] Tasks: 107 done / 113 total; 6 can run I0317 23:15:54.771161 32978 executor.go:111] Tasks: 113 done / 113 total; 0 can run I0317 23:15:54.777757 32978 target.go:111] Terraform output is in /tmp/test106868384/out --- PASS: TestDiscoveryFeatureGate (1.46s) === RUN TestVFSServiceAccountIssuerDiscovery I0317 23:15:54.783641 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:54.783849 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:54.783886 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:54.783923 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:54.783957 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:54.783998 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:54.784030 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:54.784053 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:54.784081 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:54.784103 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:54.803434 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:54.805776 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:54.805842 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:56.038612 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:56.172907 32978 executor.go:111] Tasks: 0 done / 104 total; 47 can run I0317 23:15:56.173891 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:56.173926 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:56.174042 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:56.177663 32978 executor.go:111] Tasks: 47 done / 104 total; 24 can run I0317 23:15:56.182881 32978 executor.go:111] Tasks: 71 done / 104 total; 25 can run I0317 23:15:56.183468 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:56.183677 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:56.183864 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:56.184264 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:56.184347 32978 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0317 23:15:56.184611 32978 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0317 23:15:56.184821 32978 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0317 23:15:56.189942 32978 target.go:111] Terraform output is in /tmp/test2570664859/out --- PASS: TestVFSServiceAccountIssuerDiscovery (1.41s) === RUN TestAWSLBController I0317 23:15:56.194523 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:56.194709 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:56.194739 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:56.194778 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:56.194814 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:56.194850 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:56.194884 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:56.194905 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:56.194932 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:56.194953 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:56.213773 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:56.216196 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:56.216255 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:57.475740 32978 zones.go:93] ListHostedZonesPages { } I0317 23:15:58.055380 32978 executor.go:111] Tasks: 0 done / 116 total; 54 can run I0317 23:15:58.056999 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:15:58.057021 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:15:58.057071 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:15:58.062679 32978 executor.go:111] Tasks: 54 done / 116 total; 29 can run I0317 23:15:58.067239 32978 executor.go:111] Tasks: 83 done / 116 total; 25 can run I0317 23:15:58.067457 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:58.067642 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:58.068169 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:58.068339 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:58.068445 32978 executor.go:111] Tasks: 108 done / 116 total; 2 can run I0317 23:15:58.068795 32978 executor.go:111] Tasks: 110 done / 116 total; 6 can run I0317 23:15:58.069042 32978 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0317 23:15:58.077077 32978 target.go:111] Terraform output is in /tmp/test3380258125/out --- PASS: TestAWSLBController (1.89s) === RUN TestManyAddons I0317 23:15:58.086659 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:15:58.086884 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:15:58.086920 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:15:58.086959 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:15:58.086993 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:15:58.087035 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:15:58.087072 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:15:58.087101 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:15:58.087130 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:15:58.087151 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:15:58.107330 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:15:58.110161 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:58.110227 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:15:59.384436 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:00.035395 32978 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0317 23:16:00.036589 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:00.036619 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:00.036699 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:00.043902 32978 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0317 23:16:00.048476 32978 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0317 23:16:00.048868 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:00.049267 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:00.049455 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:00.050293 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:00.050380 32978 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0317 23:16:00.050567 32978 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0317 23:16:00.050805 32978 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0317 23:16:00.057967 32978 target.go:111] Terraform output is in /tmp/test41549458/out --- PASS: TestManyAddons (1.98s) === RUN TestManyAddonsCCMIRSA I0317 23:16:00.067533 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:00.067739 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:00.067775 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:00.067818 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:00.067849 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:00.067888 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:00.067922 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:00.067944 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:00.067972 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:00.067994 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:00.092694 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:00.096239 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:00.096310 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:01.312663 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:02.004823 32978 executor.go:111] Tasks: 0 done / 123 total; 59 can run I0317 23:16:02.006415 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:02.006444 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:02.006526 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:02.008703 32978 executor.go:111] Tasks: 59 done / 123 total; 30 can run I0317 23:16:02.017345 32978 executor.go:111] Tasks: 89 done / 123 total; 26 can run I0317 23:16:02.017534 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:02.018102 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:02.018550 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:02.018863 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:02.018943 32978 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0317 23:16:02.019169 32978 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0317 23:16:02.019400 32978 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0317 23:16:02.028778 32978 target.go:111] Terraform output is in /tmp/test2465023528/out --- PASS: TestManyAddonsCCMIRSA (1.97s) === RUN TestManyAddonsCCMIRSA23 I0317 23:16:02.039065 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:02.039262 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:02.039299 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:02.039338 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:02.039369 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:02.039407 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:02.039440 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:02.039459 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:02.039490 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:02.039519 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:02.060632 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0317 23:16:02.063230 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:02.063293 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:03.323255 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:04.015264 32978 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0317 23:16:04.016014 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:04.016045 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:04.016121 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:04.022660 32978 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0317 23:16:04.027527 32978 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0317 23:16:04.027771 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:04.027887 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:04.028169 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:04.028473 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:04.028562 32978 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0317 23:16:04.028790 32978 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0317 23:16:04.029018 32978 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0317 23:16:04.037511 32978 target.go:111] Terraform output is in /tmp/test1186636306/out --- PASS: TestManyAddonsCCMIRSA23 (2.01s) === RUN TestManyAddonsCCMIRSA24 I0317 23:16:04.051610 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:04.051845 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:04.051901 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:04.051940 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:04.051973 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:04.052011 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:04.052054 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:04.052076 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:04.052104 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:04.052126 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:04.075238 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:16:04.078179 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:04.078244 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:05.365352 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:06.056966 32978 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0317 23:16:06.058496 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:06.058526 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:06.058612 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:06.060129 32978 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0317 23:16:06.064626 32978 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0317 23:16:06.065050 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:06.065255 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:06.065585 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:06.065653 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:06.065720 32978 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0317 23:16:06.065960 32978 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0317 23:16:06.066236 32978 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0317 23:16:06.074984 32978 target.go:111] Terraform output is in /tmp/test3733023887/out --- PASS: TestManyAddonsCCMIRSA24 (2.04s) === RUN TestManyAddonsCCMIRSA25 I0317 23:16:06.088784 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:06.088988 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:06.089021 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:06.089060 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:06.089091 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:06.089128 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:06.089161 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:06.089183 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:06.089210 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:06.089231 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:06.110623 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0317 23:16:06.113339 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:06.113400 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:07.391994 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:08.089658 32978 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0317 23:16:08.091368 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:08.091388 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:08.091431 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:08.093199 32978 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0317 23:16:08.097355 32978 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0317 23:16:08.097612 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:08.097800 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:08.098131 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:08.098192 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:08.098285 32978 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0317 23:16:08.098494 32978 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0317 23:16:08.098742 32978 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0317 23:16:08.107065 32978 target.go:111] Terraform output is in /tmp/test4148577546/out --- PASS: TestManyAddonsCCMIRSA25 (2.03s) === RUN TestManyAddonsCCMIRSA26 I0317 23:16:08.119593 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:08.119866 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:08.119933 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:08.120010 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:08.120066 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:08.120169 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:08.120237 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:08.120281 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:08.120333 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:08.120364 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:08.142683 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0317 23:16:08.145611 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:08.145674 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:09.390443 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:10.104915 32978 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0317 23:16:10.107137 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:10.107168 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:10.107260 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:10.108579 32978 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0317 23:16:10.116083 32978 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0317 23:16:10.116567 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:10.116752 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:10.116995 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:10.117099 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:10.117150 32978 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0317 23:16:10.117374 32978 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0317 23:16:10.117638 32978 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0317 23:16:10.125844 32978 target.go:111] Terraform output is in /tmp/test8339136/out --- PASS: TestManyAddonsCCMIRSA26 (2.02s) === RUN TestManyAddonsGCE I0317 23:16:10.135420 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:16:12.173599 32978 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0317 23:16:12.173679 32978 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0317 23:16:12.173772 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W0317 23:16:12.173796 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W0317 23:16:12.173814 32978 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W0317 23:16:12.173875 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0317 23:16:12.175003 32978 executor.go:111] Tasks: 0 done / 67 total; 44 can run I0317 23:16:12.179561 32978 executor.go:111] Tasks: 44 done / 67 total; 17 can run I0317 23:16:12.183353 32978 executor.go:111] Tasks: 61 done / 67 total; 4 can run I0317 23:16:12.184116 32978 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0317 23:16:12.184276 32978 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0317 23:16:12.188786 32978 target.go:111] Terraform output is in /tmp/test2374316239/out --- PASS: TestManyAddonsGCE (2.06s) === RUN TestCCM I0317 23:16:12.195613 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:12.195818 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:12.195856 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:12.195899 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:12.195931 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:12.195970 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:12.196004 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:12.196028 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:12.196060 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:12.196082 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:12.221569 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:12.224638 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:12.224706 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:13.501318 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:14.165156 32978 executor.go:111] Tasks: 0 done / 110 total; 51 can run I0317 23:16:14.168205 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:14.168239 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:14.168325 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:14.172370 32978 executor.go:111] Tasks: 51 done / 110 total; 24 can run I0317 23:16:14.178063 32978 executor.go:111] Tasks: 75 done / 110 total; 27 can run I0317 23:16:14.178328 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:14.178570 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:14.178843 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:14.179245 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:14.179364 32978 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0317 23:16:14.179651 32978 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0317 23:16:14.179949 32978 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0317 23:16:14.186625 32978 target.go:111] Terraform output is in /tmp/test3579803504/out --- PASS: TestCCM (2.00s) === RUN TestExternalDNS I0317 23:16:14.194928 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:14.195118 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:14.195150 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:14.195189 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:14.195219 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:14.195254 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:14.195288 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:14.195309 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:14.195336 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:14.195357 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:14.220009 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:14.222703 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:14.222778 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:15.478790 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:15.625530 32978 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0317 23:16:15.626599 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:15.626628 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:15.626717 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:15.628379 32978 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0317 23:16:15.632871 32978 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0317 23:16:15.633162 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:15.634777 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:15.635116 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:15.635816 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:15.635971 32978 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0317 23:16:15.636907 32978 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0317 23:16:15.637657 32978 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0317 23:16:15.643990 32978 target.go:111] Terraform output is in /tmp/test2772632701/out --- PASS: TestExternalDNS (1.45s) === RUN TestExternalDNSIRSA I0317 23:16:15.648560 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:15.648744 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:15.648776 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:15.648814 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:15.648847 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:15.648884 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:15.648917 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:15.648939 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:15.648966 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:15.648988 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:15.667912 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:15.670321 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:15.670385 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:16.926006 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:17.100273 32978 executor.go:111] Tasks: 0 done / 112 total; 51 can run I0317 23:16:17.103890 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:17.103930 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:17.104048 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:17.104990 32978 executor.go:111] Tasks: 51 done / 112 total; 28 can run I0317 23:16:17.112254 32978 executor.go:111] Tasks: 79 done / 112 total; 25 can run I0317 23:16:17.112658 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:17.112828 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:17.113206 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:17.113379 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:17.113493 32978 executor.go:111] Tasks: 104 done / 112 total; 2 can run I0317 23:16:17.113721 32978 executor.go:111] Tasks: 106 done / 112 total; 6 can run I0317 23:16:17.113954 32978 executor.go:111] Tasks: 112 done / 112 total; 0 can run I0317 23:16:17.121030 32978 target.go:111] Terraform output is in /tmp/test3708322702/out --- PASS: TestExternalDNSIRSA (1.48s) === RUN TestKarpenter I0317 23:16:17.126573 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:17.126796 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:17.126830 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:17.126869 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:17.126899 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:17.126938 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:17.126971 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:17.126992 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:17.127022 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:17.127044 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:17.150669 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:16:17.153487 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:17.153549 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:17.153590 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.414589 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:18.574182 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.574290 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.574367 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0317 23:16:18.672288 32978 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W0317 23:16:18.672345 32978 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0317 23:16:18.672363 32978 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W0317 23:16:18.672373 32978 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0317 23:16:18.672385 32978 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I0317 23:16:18.692687 32978 executor.go:111] Tasks: 0 done / 122 total; 54 can run I0317 23:16:18.694151 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:18.694182 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:18.694252 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:18.696568 32978 executor.go:111] Tasks: 54 done / 122 total; 31 can run I0317 23:16:18.704742 32978 executor.go:111] Tasks: 85 done / 122 total; 29 can run I0317 23:16:18.705025 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.705210 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.705350 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.705651 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.705720 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.705842 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.705909 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.706064 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.706216 32978 executor.go:111] Tasks: 114 done / 122 total; 2 can run I0317 23:16:18.706598 32978 executor.go:111] Tasks: 116 done / 122 total; 6 can run I0317 23:16:18.706801 32978 executor.go:111] Tasks: 122 done / 122 total; 0 can run I0317 23:16:18.715133 32978 target.go:111] Terraform output is in /tmp/test2195789521/out --- PASS: TestKarpenter (1.60s) === RUN TestSharedSubnet I0317 23:16:18.721987 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:18.722189 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:18.722226 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:18.722262 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:18.722296 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:18.722335 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:18.722367 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:18.722388 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:18.722419 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:18.722441 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:18.741167 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:18.743701 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:18.743763 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:19.987427 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:20.129886 32978 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0317 23:16:20.134357 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:20.134564 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:20.135697 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:20.137557 32978 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0317 23:16:20.137952 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:16:20.142342 32978 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0317 23:16:20.142655 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:20.142837 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:20.143063 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:20.143480 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:20.143569 32978 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0317 23:16:20.143830 32978 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0317 23:16:20.144097 32978 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0317 23:16:20.148984 32978 target.go:111] Terraform output is in /tmp/test1563557547/out --- PASS: TestSharedSubnet (1.43s) === RUN TestSharedVPC I0317 23:16:20.153322 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:20.153530 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:20.153563 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:20.153601 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:20.153631 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:20.153666 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:20.153712 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:20.153742 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:20.153769 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:20.153792 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:20.172033 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:20.174455 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:20.174518 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:21.427757 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:21.571210 32978 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0317 23:16:21.571829 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:21.571858 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:21.571932 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:21.573570 32978 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0317 23:16:21.573749 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:16:21.578193 32978 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0317 23:16:21.578590 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:21.578751 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:21.578987 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:21.579149 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:21.579215 32978 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0317 23:16:21.579443 32978 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0317 23:16:21.579668 32978 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0317 23:16:21.585038 32978 target.go:111] Terraform output is in /tmp/test554928118/out --- PASS: TestSharedVPC (1.44s) === RUN TestSharedVPCIPv6 I0317 23:16:21.589588 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:21.589790 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:21.589825 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:21.589863 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:21.589899 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:21.589937 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:21.589974 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:21.589996 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:21.590028 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:21.590050 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:21.591674 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:16:21.591726 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:16:21.617109 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:16:21.617162 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0317 23:16:21.617238 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:16:21.620369 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:21.620434 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:22.847257 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:22.989330 32978 executor.go:111] Tasks: 0 done / 133 total; 45 can run I0317 23:16:22.991990 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:22.992026 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:22.992103 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:22.996077 32978 executor.go:111] Tasks: 45 done / 133 total; 29 can run I0317 23:16:22.996259 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:16:22.996372 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:16:22.999003 32978 executor.go:111] Tasks: 74 done / 133 total; 37 can run I0317 23:16:22.999748 32978 executor.go:111] Tasks: 111 done / 133 total; 6 can run I0317 23:16:22.999814 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:16:22.999883 32978 loadbalancers.go:35] PageSize not implemented I0317 23:16:22.999989 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:16:23.000056 32978 loadbalancers.go:35] PageSize not implemented I0317 23:16:23.004354 32978 executor.go:111] Tasks: 117 done / 133 total; 8 can run I0317 23:16:23.004469 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:23.004570 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:23.004733 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:23.005160 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:23.005247 32978 executor.go:111] Tasks: 125 done / 133 total; 2 can run I0317 23:16:23.005450 32978 executor.go:111] Tasks: 127 done / 133 total; 6 can run I0317 23:16:23.005697 32978 executor.go:111] Tasks: 133 done / 133 total; 0 can run I0317 23:16:23.011984 32978 target.go:111] Terraform output is in /tmp/test2410274205/out --- PASS: TestSharedVPCIPv6 (1.43s) === RUN TestExistingIAM I0317 23:16:23.016648 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:23.016884 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:23.016920 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:23.016958 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:23.016989 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:23.017029 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:23.017068 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:23.017088 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:23.017117 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:23.017140 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:23.046421 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:23.049962 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:23.050100 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:23.050146 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:23.050182 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:24.324896 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:24.480472 32978 executor.go:111] Tasks: 0 done / 117 total; 51 can run I0317 23:16:24.483302 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:24.483331 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:24.483442 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:24.484282 32978 executor.go:111] Tasks: 51 done / 117 total; 19 can run I0317 23:16:24.488705 32978 executor.go:111] Tasks: 70 done / 117 total; 31 can run I0317 23:16:24.488899 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:24.489088 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:24.490377 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:24.490592 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:24.490835 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:24.490998 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:24.491136 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:24.491406 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:24.491590 32978 executor.go:111] Tasks: 101 done / 117 total; 4 can run I0317 23:16:24.493104 32978 executor.go:111] Tasks: 105 done / 117 total; 12 can run I0317 23:16:24.494577 32978 executor.go:111] Tasks: 117 done / 117 total; 0 can run I0317 23:16:24.501919 32978 target.go:111] Terraform output is in /tmp/test1842430375/out --- PASS: TestExistingIAM (1.49s) === RUN TestPhaseNetwork I0317 23:16:24.507092 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:24.507304 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:24.507342 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:24.507385 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:24.507418 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:24.507459 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:24.507493 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:24.507515 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:24.507547 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:24.507570 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:24.528117 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:24.530544 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:24.530668 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:24.530707 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:25.750653 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:25.894888 32978 executor.go:111] Tasks: 0 done / 135 total; 47 can run I0317 23:16:25.895316 32978 executor.go:111] Tasks: 47 done / 135 total; 30 can run I0317 23:16:25.895686 32978 executor.go:111] Tasks: 77 done / 135 total; 36 can run I0317 23:16:25.896040 32978 executor.go:111] Tasks: 113 done / 135 total; 6 can run I0317 23:16:25.896276 32978 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0317 23:16:25.896434 32978 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0317 23:16:25.896521 32978 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0317 23:16:25.896578 32978 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0317 23:16:25.897470 32978 target.go:111] Terraform output is in /tmp/test3621032974/out --- PASS: TestPhaseNetwork (1.39s) === RUN TestExternalLoadBalancer I0317 23:16:25.898014 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:25.898204 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:25.898236 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:25.898275 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:25.898307 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:25.898343 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:25.898376 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:25.898397 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:25.898424 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:25.898446 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:25.917123 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:25.919562 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:25.919630 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:27.135338 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:27.276806 32978 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0317 23:16:27.277432 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:27.277463 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:27.277542 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:27.279576 32978 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0317 23:16:27.283959 32978 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0317 23:16:27.284128 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:27.284503 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:27.284682 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:27.286386 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:27.286506 32978 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0317 23:16:27.287124 32978 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0317 23:16:27.287746 32978 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0317 23:16:27.296160 32978 target.go:111] Terraform output is in /tmp/test1363209746/out --- PASS: TestExternalLoadBalancer (1.40s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I0317 23:16:27.301318 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:27.301525 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:27.301563 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:27.301604 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:27.301636 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:27.301675 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:27.301707 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:27.301728 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:27.301756 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:27.301778 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:27.326830 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:27.329586 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:27.329647 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:27.329684 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:27.329720 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:27.329753 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:27.329781 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:27.329816 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.580765 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:28.728501 32978 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0317 23:16:28.729241 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:28.729268 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:28.729379 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:28.731097 32978 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0317 23:16:28.738524 32978 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0317 23:16:28.738953 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.739093 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.739209 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.739411 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.739570 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.739636 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.739681 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.739783 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.739882 32978 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0317 23:16:28.740190 32978 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0317 23:16:28.740488 32978 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0317 23:16:28.747612 32978 target.go:111] Terraform output is in /tmp/test3870083696/out --- PASS: TestMixedInstancesASG (1.45s) === RUN TestMixedInstancesSpotASG I0317 23:16:28.753175 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:28.753381 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:28.753441 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:28.753488 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:28.753522 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:28.753560 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:28.753593 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:28.753613 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:28.753642 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:28.753664 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:28.782838 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:28.785811 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.785883 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.785923 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.785959 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.785993 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.786029 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:28.786058 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:30.043619 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:30.188763 32978 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0317 23:16:30.192823 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:30.192855 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:30.192929 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:30.197476 32978 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0317 23:16:30.202417 32978 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0317 23:16:30.202705 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:30.202852 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:30.203065 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:30.203230 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:30.203305 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:30.203444 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:30.203645 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:30.203712 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:30.203789 32978 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0317 23:16:30.204063 32978 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0317 23:16:30.204363 32978 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0317 23:16:30.211672 32978 target.go:111] Terraform output is in /tmp/test2773837716/out --- PASS: TestMixedInstancesSpotASG (1.47s) === RUN TestAdditionalObjects I0317 23:16:30.219922 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:30.220151 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:30.220184 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:30.220224 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:30.220256 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:30.220292 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:30.220323 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:30.220342 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:30.220369 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:30.220396 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:30.241454 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0317 23:16:30.243985 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:30.244048 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:31.512084 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:31.649376 32978 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0317 23:16:31.650944 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:31.650960 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:31.651003 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:31.652968 32978 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0317 23:16:31.656150 32978 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0317 23:16:31.656395 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:31.656577 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:31.656784 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:31.656948 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:31.657000 32978 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0317 23:16:31.657218 32978 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0317 23:16:31.657434 32978 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0317 23:16:31.662739 32978 target.go:111] Terraform output is in /tmp/test2231322066/out --- PASS: TestAdditionalObjects (1.45s) === RUN TestContainerd I0317 23:16:31.667076 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:31.667262 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:31.667293 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:31.667328 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:31.667358 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:31.667391 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:31.667425 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:31.667447 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:31.667475 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:31.667495 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:31.689902 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:31.692313 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:31.692378 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:32.923658 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:33.061932 32978 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0317 23:16:33.062281 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:33.062315 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:33.062395 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:33.064438 32978 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0317 23:16:33.068438 32978 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0317 23:16:33.068652 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:33.070547 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:33.070912 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:33.071485 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:33.071656 32978 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0317 23:16:33.072909 32978 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0317 23:16:33.073340 32978 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0317 23:16:33.079350 32978 target.go:111] Terraform output is in /tmp/test502530829/out --- PASS: TestContainerd (1.42s) === RUN TestContainerdCustom I0317 23:16:33.083619 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:33.083804 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:33.083836 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:33.083876 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:33.083906 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:33.083941 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:33.083973 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:33.083994 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:33.084020 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:33.084042 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:33.104876 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:33.107758 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:33.107828 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:33.569296 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:33.706007 32978 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0317 23:16:33.707557 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:33.707589 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:33.707665 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:33.709056 32978 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0317 23:16:33.714364 32978 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0317 23:16:33.714706 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:33.714870 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:33.715237 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:33.715284 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:33.715375 32978 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0317 23:16:33.715597 32978 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0317 23:16:33.715864 32978 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0317 23:16:33.721307 32978 target.go:111] Terraform output is in /tmp/test330270478/out --- PASS: TestContainerdCustom (0.64s) === RUN TestDockerCustom I0317 23:16:33.725851 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:33.726055 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:33.726090 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:33.726141 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:33.726172 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:33.726210 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:33.726246 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:33.726267 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:33.726295 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:33.726319 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:33.745973 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0317 23:16:33.748759 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:33.748823 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:34.208910 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:34.343082 32978 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0317 23:16:34.343712 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:34.343746 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:34.343844 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:34.346755 32978 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0317 23:16:34.351356 32978 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0317 23:16:34.351689 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:34.351882 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:34.352245 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:34.352311 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:34.352374 32978 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0317 23:16:34.352642 32978 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0317 23:16:34.352891 32978 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0317 23:16:34.398609 32978 target.go:111] Terraform output is in /tmp/test567800876/out --- PASS: TestDockerCustom (0.68s) === RUN TestAPIServerNodes I0317 23:16:34.402882 32978 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0317 23:16:34.402909 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:34.403090 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:34.403122 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:34.403157 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:34.403189 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:34.403227 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:34.403260 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:34.403280 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:34.403306 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:34.403330 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:34.422976 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0317 23:16:34.425433 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:34.425490 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:34.425530 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:35.707939 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:35.849641 32978 executor.go:111] Tasks: 0 done / 114 total; 47 can run I0317 23:16:35.850700 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:35.850731 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:35.850801 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:35.852209 32978 executor.go:111] Tasks: 47 done / 114 total; 28 can run I0317 23:16:35.856579 32978 executor.go:111] Tasks: 75 done / 114 total; 27 can run I0317 23:16:35.856858 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:35.857008 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:35.857190 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:35.857386 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:35.858530 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:35.858884 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:35.859084 32978 executor.go:111] Tasks: 102 done / 114 total; 3 can run I0317 23:16:35.859666 32978 executor.go:111] Tasks: 105 done / 114 total; 9 can run I0317 23:16:35.860941 32978 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0317 23:16:35.867642 32978 target.go:111] Terraform output is in /tmp/test1394124873/out I0317 23:16:35.872273 32978 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (1.47s) === RUN TestNTHIMDSProcessor I0317 23:16:35.872380 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:35.872557 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:35.872588 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:35.872624 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:35.872655 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:35.872691 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:35.872722 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:35.872742 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:35.872768 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:35.872788 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:35.891973 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:35.894631 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:35.894701 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:37.102511 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:37.236931 32978 executor.go:111] Tasks: 0 done / 90 total; 44 can run I0317 23:16:37.237908 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:37.237940 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:37.238020 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:37.242961 32978 executor.go:111] Tasks: 44 done / 90 total; 19 can run I0317 23:16:37.247441 32978 executor.go:111] Tasks: 63 done / 90 total; 21 can run I0317 23:16:37.247704 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:37.248050 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:37.248235 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:37.248619 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:37.248708 32978 executor.go:111] Tasks: 84 done / 90 total; 2 can run I0317 23:16:37.248958 32978 executor.go:111] Tasks: 86 done / 90 total; 4 can run I0317 23:16:37.249183 32978 executor.go:111] Tasks: 90 done / 90 total; 0 can run I0317 23:16:37.254086 32978 target.go:111] Terraform output is in /tmp/test1699752473/out --- PASS: TestNTHIMDSProcessor (1.39s) === RUN TestNTHIMDSProcessorIRSA I0317 23:16:37.257995 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:37.258180 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:37.258210 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:37.258244 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:37.258274 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:37.258309 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:37.258340 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:37.258361 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:37.258388 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:37.258408 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:37.277518 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:37.280019 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:37.280096 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:38.494026 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:38.666479 32978 executor.go:111] Tasks: 0 done / 101 total; 50 can run I0317 23:16:38.667929 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:38.667959 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:38.668041 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:38.672286 32978 executor.go:111] Tasks: 50 done / 101 total; 24 can run I0317 23:16:38.678719 32978 executor.go:111] Tasks: 74 done / 101 total; 21 can run I0317 23:16:38.679042 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:38.679449 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:38.680096 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:38.680651 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:38.680732 32978 executor.go:111] Tasks: 95 done / 101 total; 2 can run I0317 23:16:38.680988 32978 executor.go:111] Tasks: 97 done / 101 total; 4 can run I0317 23:16:38.681224 32978 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0317 23:16:38.686814 32978 target.go:111] Terraform output is in /tmp/test4153060908/out --- PASS: TestNTHIMDSProcessorIRSA (1.43s) === RUN TestCustomIRSA I0317 23:16:38.691764 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:38.691947 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:38.691979 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:38.692015 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:38.692044 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:38.692082 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:38.692112 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:38.692133 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:38.692162 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:38.692183 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:38.713354 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:38.716316 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:38.716375 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:40.000439 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:40.538875 32978 executor.go:111] Tasks: 0 done / 114 total; 52 can run I0317 23:16:40.539479 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:40.539509 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:40.539585 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:40.541940 32978 executor.go:111] Tasks: 52 done / 114 total; 29 can run I0317 23:16:40.546393 32978 executor.go:111] Tasks: 81 done / 114 total; 25 can run I0317 23:16:40.546709 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:40.546904 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:40.547238 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:40.547307 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:40.547373 32978 executor.go:111] Tasks: 106 done / 114 total; 2 can run I0317 23:16:40.547578 32978 executor.go:111] Tasks: 108 done / 114 total; 6 can run I0317 23:16:40.547790 32978 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0317 23:16:40.558240 32978 target.go:111] Terraform output is in /tmp/test3557044984/out --- PASS: TestCustomIRSA (1.88s) === RUN TestClusterNameDigit I0317 23:16:40.567876 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:40.568071 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:40.568113 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:40.568184 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:40.568229 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:40.568286 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:40.568333 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:40.568362 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:40.568412 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:40.568432 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:40.589846 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:16:40.592652 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:40.592714 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:41.792886 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:41.934469 32978 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0317 23:16:41.934740 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:41.934770 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:41.934851 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:41.941408 32978 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0317 23:16:41.946367 32978 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0317 23:16:41.947125 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:41.947501 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:41.947753 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:41.947873 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:41.947923 32978 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0317 23:16:41.948138 32978 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0317 23:16:41.948295 32978 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0317 23:16:41.953879 32978 target.go:111] Terraform output is in /tmp/test3828947084/out --- PASS: TestClusterNameDigit (1.39s) === RUN TestCASPriorityExpander I0317 23:16:41.958831 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:41.959021 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:41.959052 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:41.959088 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:41.959121 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:41.959156 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:41.959188 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:41.959208 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:41.959236 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:41.959257 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:41.981489 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0317 23:16:41.984356 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:41.984418 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:41.984456 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:41.984491 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0317 23:16:44.080605 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:44.245215 32978 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0317 23:16:44.246325 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:44.246350 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:44.246418 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:44.247986 32978 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0317 23:16:44.256650 32978 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0317 23:16:44.256968 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:44.257109 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:44.257347 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:44.257467 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:44.257606 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:44.257738 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:44.258015 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:44.258133 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:44.258213 32978 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0317 23:16:44.258535 32978 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0317 23:16:44.258807 32978 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0317 23:16:44.265508 32978 target.go:111] Terraform output is in /tmp/test3222372575/out --- PASS: TestCASPriorityExpander (2.31s) === RUN TestCASPriorityExpanderCustom I0317 23:16:44.270613 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:44.270800 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:44.270830 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:44.270868 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:44.270898 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:44.270934 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:44.270966 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:44.270987 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:44.271015 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:44.271036 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:16:44.293925 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0317 23:16:44.296701 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:44.296792 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:44.296830 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:44.296862 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0317 23:16:45.526448 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:45.689729 32978 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0317 23:16:45.690298 32978 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0317 23:16:45.690337 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:45.690417 32978 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0317 23:16:45.692528 32978 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0317 23:16:45.701244 32978 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0317 23:16:45.701449 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:45.701664 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:45.701960 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:45.702210 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:45.702280 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:45.702436 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:45.702499 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:45.702779 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:45.702860 32978 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0317 23:16:45.703308 32978 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0317 23:16:45.703869 32978 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0317 23:16:45.710142 32978 target.go:111] Terraform output is in /tmp/test4266414209/out --- PASS: TestCASPriorityExpanderCustom (1.44s) === RUN TestLifecycleMinimalAWS I0317 23:16:45.715099 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:16:45.715281 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:16:45.715315 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:16:45.715353 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:16:45.715382 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:16:45.715418 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:16:45.715448 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:16:45.715468 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:16:45.715496 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:16:45.715516 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0317 23:16:45.732691 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0317 23:16:45.735084 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:45.735142 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0317 23:16:47.001280 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:47.143129 32978 iamrole.go:89] ListRoles: { } I0317 23:16:47.144162 32978 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0317 23:16:47.144608 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:47.144825 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:16:47.144963 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:16:47.145006 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:47.145102 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:16:47.145265 32978 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I0317 23:16:47.145319 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0317 23:16:47.145420 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:16:47.145526 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:16:47.145476 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0317 23:16:47.145567 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:47.145574 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:47.145773 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0317 23:16:47.145780 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0317 23:16:47.145855 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" }] } I0317 23:16:47.145989 32978 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I0317 23:16:47.145995 32978 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:16:47.146109 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:16:47.146157 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0317 23:16:47.146186 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0317 23:16:47.146207 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:16:47.146239 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:16:47.147086 32978 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0317 23:16:47.147215 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0317 23:16:47.147264 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0317 23:16:47.147380 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:47.147455 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0317 23:16:47.147524 32978 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0317 23:16:47.147495 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:16:47.147549 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0317 23:16:47.147590 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:47.147659 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0317 23:16:47.147706 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0317 23:16:47.147729 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0317 23:16:47.147790 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:47.147819 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" } ] }], VpcId: "vpc-1" } I0317 23:16:47.147887 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:16:47.147922 32978 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0317 23:16:47.147998 32978 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I0317 23:16:47.148062 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:16:47.148097 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }], VpcId: "vpc-1" } I0317 23:16:47.148162 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:16:47.148198 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:16:47.148240 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:16:47.148368 32978 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0317 23:16:47.148439 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:16:47.148477 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:16:47.148511 32978 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0317 23:16:47.148558 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0317 23:16:47.148719 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0317 23:16:47.148784 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:16:47.148829 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:16:47.149166 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0317 23:16:47.151507 32978 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0317 23:16:47.151682 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:47.151784 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:16:47.151956 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0317 23:16:47.152011 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0317 23:16:47.152047 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:47.152229 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:16:47.152527 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:16:47.152772 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:47.152864 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:16:47.152942 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:16:47.153142 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0317 23:16:47.153305 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:16:47.153366 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:16:47.153495 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:16:47.153615 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:47.153747 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0317 23:16:47.153820 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" }] }] } I0317 23:16:47.153946 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:16:47.154053 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:16:47.154162 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:16:47.154261 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" }] }] } I0317 23:16:47.154358 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0317 23:16:47.154457 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0317 23:16:47.154494 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:16:47.154590 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:16:47.154736 32978 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0317 23:16:47.154971 32978 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0317 23:16:47.155202 32978 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0317 23:16:47.155238 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:47.155272 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:16:47.155332 32978 dns.go:235] Pre-creating DNS records I0317 23:16:47.155357 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:16:47.159732 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0317 23:16:47.162299 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:47.162368 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0317 23:16:48.480923 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:48.619140 32978 iamrole.go:89] ListRoles: { } I0317 23:16:48.620027 32978 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0317 23:16:48.620341 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.620502 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.620531 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:16:48.620739 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.620829 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:16:48.620856 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:16:48.620895 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:16:48.621335 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.621495 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:16:48.623204 32978 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0317 23:16:48.623331 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0317 23:16:48.623468 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:16:48.623497 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0317 23:16:48.623596 32978 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0317 23:16:48.623521 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0317 23:16:48.623693 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:16:48.623737 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.623885 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:16:48.623920 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.624022 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.624115 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:16:48.624185 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:16:48.631770 32978 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0317 23:16:48.632178 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:16:48.632412 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:16:48.632591 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:48.632843 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:48.632995 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:48.633066 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:16:48.633247 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:16:48.633667 32978 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0317 23:16:48.633921 32978 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0317 23:16:48.634166 32978 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0317 23:16:48.636153 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0317 23:16:48.636207 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:16:48.636236 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0317 23:16:48.636258 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:16:48.636282 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0317 23:16:48.636303 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0317 23:16:48.636323 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:16:48.636346 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0317 23:16:48.636369 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0317 23:16:48.636399 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0317 23:16:48.636425 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:16:48.636445 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:16:48.636467 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:16:48.636489 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0317 23:16:48.636511 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:16:48.636533 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:16:48.636556 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:16:48.636580 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:16:48.636627 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:16:48.636650 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0317 23:16:48.636672 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:16:48.636697 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:16:48.636723 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:16:48.636769 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0317 23:16:48.637703 32978 delete_cluster.go:128] Looking for cloud resources to delete W0317 23:16:48.637781 32978 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0317 23:16:48.637799 32978 keypairs.go:95] DescribeKeyPairs: { } I0317 23:16:48.637832 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.637893 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0317 23:16:48.637939 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.637982 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.638014 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.638053 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.638085 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.638113 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0317 23:16:48.638147 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.638184 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:16:48.638211 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0317 23:16:48.638241 32978 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0317 23:16:48.638268 32978 api.go:53] PageSize not implemented I0317 23:16:48.638287 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:16:48.638309 32978 loadbalancers.go:35] PageSize not implemented I0317 23:16:48.638324 32978 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0317 23:16:48.638347 32978 targetgroups.go:35] PageSize not implemented I0317 23:16:48.638361 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0317 23:16:48.638403 32978 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0317 23:16:48.638439 32978 iamrole.go:89] ListRoles: { } I0317 23:16:48.638476 32978 zones.go:93] ListHostedZonesPages { } I0317 23:16:48.638498 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:16:48.638531 32978 internetgateways.go:101] DescribeInternetGateways: { } I0317 23:16:48.638566 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:16:48.638593 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:16:48.638952 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-group:nodes.minimal.example.com ok autoscaling-config:lt-2 ok I0317 23:16:48.639017 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0317 23:16:48.639084 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0317 23:16:48.639038 32978 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0317 23:16:48.639137 32978 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-1 ok I0317 23:16:48.639047 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:16:48.639177 32978 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0317 23:16:48.639150 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok keypair:key-1 ok I0317 23:16:48.639229 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0317 23:16:48.639221 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } iam-instance-profile:masters.minimal.example.com ok I0317 23:16:48.639262 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0317 23:16:48.639455 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:16:48.639476 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0317 23:16:48.639505 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0317 23:16:48.639545 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:16:48.639579 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0317 23:16:48.639659 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:16:48.639670 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0317 23:16:48.639733 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0317 23:16:48.639769 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0317 23:16:48.639845 32978 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0317 23:16:48.639861 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0317 23:16:48.639898 32978 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0317 23:16:48.639929 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0317 23:16:48.639962 32978 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0317 23:16:48.639974 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0317 23:16:48.639994 32978 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0317 23:16:48.640050 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0317 23:16:48.640143 32978 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0317 23:16:48.640201 32978 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (2.93s) === RUN TestLifecycleMinimalOpenstack I0317 23:16:48.640680 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I0317 23:16:48.646634 32978 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:16:49.978037 32978 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0317 23:16:49.978070 32978 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0317 23:16:49.991404 32978 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/03/17 23:16:49 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:16:49 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0317 23:16:49.998541 32978 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0317 23:16:50.006296 32978 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0317 23:16:50.012631 32978 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/03/17 23:16:50 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:16:50 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:16:50 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0317 23:16:50.015102 32978 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0317 23:16:50.015142 32978 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0317 23:16:50.015342 32978 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0317 23:16:51.019461 32978 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:16:52.355123 32978 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0317 23:16:52.355158 32978 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0317 23:16:52.370176 32978 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/03/17 23:16:52 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:16:52 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0317 23:16:52.378116 32978 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0317 23:16:52.383564 32978 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0317 23:16:52.384922 32978 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/03/17 23:16:52 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:16:52 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:16:52 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0317 23:16:52.387381 32978 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0317 23:16:52.387445 32978 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0317 23:16:52.387719 32978 executor.go:111] Tasks: 92 done / 92 total; 0 can run I0317 23:16:52.388847 32978 delete_cluster.go:128] Looking for cloud resources to delete 2025/03/17 23:16:52 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) SecurityGroup:50cdcf68-f0d1-43c1-8b61-75e7e6bda360 ok Network:e1f76fe8-2e33-47f2-8ceb-2d43c8822d18 ok Instance:a38d659f-2dec-44ee-82ae-1d6812bd6772 ok SecurityGroup:2bb61a2a-d5af-4cd0-bcb5-bb46b65e74e4 ok Instance:c0f1906b-4c99-415b-b0fa-ac40c993ff89 ok Port:f278a96f-7457-45ce-bebd-fafd222325b3 ok ServerGroup:5957a9a2-eced-46d5-ad7b-21e1d76e3bd7 ok SecurityGroup:5525203d-3c18-41a2-9bd6-3c74e5335749 ok Port:697ea458-6e7c-4e47-916b-322857d3a334 ok Port:ede88f9e-3ce5-4b51-ad0c-a79c4e75021e ok Subnet:0ca41490-14e5-47a7-beed-f059b0b45f10 ok ServerGroup:b3b7d9d9-8074-4688-88a8-337d19c5bea3 ok Instance:2264569e-fe30-4677-afda-42c667578857 ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok --- PASS: TestLifecycleMinimalOpenstack (4.86s) === RUN TestLifecycleMinimalGCE I0317 23:16:53.500576 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I0317 23:16:53.502102 32978 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:16:55.117004 32978 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0317 23:16:55.117111 32978 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0317 23:16:55.117200 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0317 23:16:55.117219 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0317 23:16:55.117238 32978 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0317 23:16:55.117287 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0317 23:16:55.118275 32978 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0317 23:16:55.120952 32978 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0317 23:16:55.127656 32978 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0317 23:16:55.128478 32978 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0317 23:16:55.128681 32978 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0317 23:16:55.128755 32978 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:16:56.764304 32978 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0317 23:16:56.764383 32978 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0317 23:16:56.764467 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0317 23:16:56.764491 32978 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0317 23:16:56.764511 32978 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0317 23:16:56.764561 32978 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0317 23:16:56.765543 32978 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0317 23:16:56.769017 32978 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0317 23:16:56.773307 32978 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0317 23:16:56.774115 32978 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0317 23:16:56.774248 32978 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0317 23:16:56.775525 32978 delete_cluster.go:128] Looking for cloud resources to delete I0317 23:16:56.775590 32978 gce.go:99] Scanning zones: [us-test1-a] I0317 23:16:56.775898 32978 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I0317 23:16:56.775918 32978 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:ssh-external-to-node-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1742253415 ok InstanceTemplate:nodes-minimal-gce-example-com-1742253415 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (3.28s) === RUN TestLifecycleFloatingIPOpenstack I0317 23:16:56.777270 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I0317 23:16:56.783457 32978 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:16:58.133873 32978 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0317 23:16:58.133902 32978 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0317 23:16:58.148385 32978 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/03/17 23:16:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:16:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0317 23:16:58.152372 32978 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0317 23:16:58.161908 32978 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0317 23:16:58.164101 32978 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/03/17 23:16:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:16:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:16:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0317 23:16:58.166051 32978 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0317 23:16:58.166164 32978 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0317 23:16:59.169930 32978 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0317 23:17:00.515950 32978 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0317 23:17:00.515985 32978 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0317 23:17:00.531545 32978 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/03/17 23:17:00 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:17:00 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0317 23:17:00.538956 32978 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0317 23:17:00.545289 32978 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0317 23:17:00.546662 32978 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/03/17 23:17:00 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:17:00 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/03/17 23:17:00 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0317 23:17:00.548786 32978 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0317 23:17:00.550941 32978 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0317 23:17:00.552057 32978 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0317 23:17:00.556358 32978 delete_cluster.go:128] Looking for cloud resources to delete 2025/03/17 23:17:00 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Router-IF:1804e24f-791c-4d24-ac52-8aae3fdec301 ok Router:2a2e3975-a4cd-45f6-9380-425d9ac9c4c1 ok Port:ab86d4b6-f10c-47ec-b8ee-f65f45949cd8 ok Instance:07f1365f-74a0-4f6a-b4bf-22331e0a9503 ok SecurityGroup:817027b1-59ec-4aa5-b293-da6d5b374a6c ok Instance:892fd9cc-e3b3-47ab-b086-58aa0d7916ca ok Port:bf06c903-8ef9-401b-97c7-bbb9af651806 ok ServerGroup:8c10f0d4-b815-4596-a95c-6ac2052c2704 ok Subnet:1804e24f-791c-4d24-ac52-8aae3fdec301 ok SecurityGroup:0dcd53ca-c6da-4f7e-8eac-261e322b158f ok Port:69ea2b11-a4f5-400c-9534-a01f849e9dd6 ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Network:c17c4267-8c62-45cb-a61f-3c0e7668cab6 ok ServerGroup:bb62e2af-1c62-4139-b075-c8457f19a0a4 ok Instance:e011b1c4-9ca4-474c-8200-1bdec8f41a6f ok SecurityGroup:67febad3-d941-49a9-a7f6-d44b5f8707fa ok Port:03f428fe-1fc6-4fbd-ad79-badbb8777b0c ok --- PASS: TestLifecycleFloatingIPOpenstack (4.87s) === RUN TestLifecyclePrivateCalico I0317 23:17:01.647916 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:17:01.648150 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:17:01.648187 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:17:01.648230 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:17:01.648262 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:17:01.648301 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:17:01.648333 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:17:01.648354 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:17:01.648381 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:17:01.648403 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I0317 23:17:01.670505 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:17:01.673487 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:01.673557 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:01.673601 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:02.884868 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:03.218174 32978 iamrole.go:89] ListRoles: { } I0317 23:17:03.219699 32978 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0317 23:17:03.219959 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I0317 23:17:03.220133 32978 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.220234 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:17:03.220179 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0317 23:17:03.220323 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.privatecalico.example.com" }] } I0317 23:17:03.220320 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:03.220462 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:03.220599 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:03.220780 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:03.220843 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:03.221012 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I0317 23:17:03.221088 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0317 23:17:03.221038 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:03.221198 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:03.221256 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:03.221444 32978 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.221462 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0317 23:17:03.221554 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0317 23:17:03.221618 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:03.221813 32978 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0317 23:17:03.221916 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0317 23:17:03.221955 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0317 23:17:03.221991 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:03.222038 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:03.222908 32978 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0317 23:17:03.223027 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0317 23:17:03.223090 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0317 23:17:03.223165 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:03.223282 32978 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0317 23:17:03.223247 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0317 23:17:03.223325 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0317 23:17:03.223389 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0317 23:17:03.223427 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }], VpcId: "vpc-1" } I0317 23:17:03.223427 32978 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0317 23:17:03.223434 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0317 23:17:03.223514 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:03.223523 32978 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0317 23:17:03.223635 32978 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0317 23:17:03.223565 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0317 23:17:03.223753 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:03.223797 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:03.223775 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0317 23:17:03.223875 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0317 23:17:03.223830 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0317 23:17:03.223977 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatecalico.example.com" }] }], VpcId: "vpc-1" } I0317 23:17:03.224045 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:03.224077 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:03.224087 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0317 23:17:03.224107 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:03.224174 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0317 23:17:03.224252 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0317 23:17:03.224259 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:03.224421 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:03.224498 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0317 23:17:03.224569 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0317 23:17:03.224584 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:03.224733 32978 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.224799 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0317 23:17:03.224891 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:03.224960 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:03.225026 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:03.225019 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0317 23:17:03.225051 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0317 23:17:03.225123 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:03.225161 32978 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] } I0317 23:17:03.225218 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:03.225253 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:03.225070 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0317 23:17:03.225282 32978 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0317 23:17:03.225340 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0317 23:17:03.225380 32978 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] } I0317 23:17:03.225440 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:03.225475 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatecalico.example.com" }] }], VpcId: "vpc-1" } I0317 23:17:03.225538 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0317 23:17:03.225574 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0317 23:17:03.225609 32978 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0317 23:17:03.225651 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:03.225682 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:03.225754 32978 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0317 23:17:03.225893 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } W0317 23:17:03.226016 32978 api.go:53] PageSize not implemented I0317 23:17:03.226056 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:03.226131 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:03.226069 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.226160 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:03.226226 32978 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }], Type: "network" } I0317 23:17:03.226232 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0317 23:17:03.226273 32978 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0317 23:17:03.226321 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:03.226345 32978 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0317 23:17:03.226394 32978 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0317 23:17:03.226366 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0317 23:17:03.226508 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.226628 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.226818 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0317 23:17:03.226940 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:03.227043 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0317 23:17:03.227090 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0317 23:17:03.227243 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:03.227348 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:03.227406 32978 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.227436 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:03.227513 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.227644 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:03.227750 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0317 23:17:03.227855 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0317 23:17:03.227988 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.228103 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.228212 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.228306 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0317 23:17:03.228401 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0317 23:17:03.228501 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:03.228539 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0317 23:17:03.228568 32978 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } I0317 23:17:03.228572 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" }] }] } W0317 23:17:03.228655 32978 api.go:53] PageSize not implemented I0317 23:17:03.228674 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:03.228671 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" }] }] } I0317 23:17:03.228767 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.228859 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I0317 23:17:03.228952 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" }] }] } I0317 23:17:03.229049 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.229140 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.229243 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:03.229331 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.229428 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I0317 23:17:03.229517 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0317 23:17:03.229586 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.229688 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0317 23:17:03.229727 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0317 23:17:03.229767 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" }] }] } I0317 23:17:03.229867 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0317 23:17:03.229934 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:03.230015 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0317 23:17:03.230046 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0317 23:17:03.230183 32978 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0317 23:17:03.230234 32978 api.go:53] PageSize not implemented I0317 23:17:03.230273 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:03.230288 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0317 23:17:03.230346 32978 api.go:53] PageSize not implemented I0317 23:17:03.230264 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:03.230410 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:03.230430 32978 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:03.230361 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:03.230576 32978 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0317 23:17:03.230594 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:03.230691 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0317 23:17:03.230730 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:03.230713 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:03.230768 32978 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0317 23:17:03.234547 32978 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0317 23:17:03.234730 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:03.234848 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:03.234919 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:03.235021 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0317 23:17:03.235056 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:03.235129 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:03.235633 32978 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0317 23:17:03.235828 32978 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0317 23:17:03.236047 32978 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0317 23:17:03.236092 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:03.236123 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:03.236180 32978 dns.go:235] Pre-creating DNS records I0317 23:17:03.236202 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:03.241221 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:17:03.244073 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:03.244141 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:03.244183 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:04.462507 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:04.811964 32978 iamrole.go:89] ListRoles: { } I0317 23:17:04.813163 32978 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0317 23:17:04.813698 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:04.813936 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] }] } I0317 23:17:04.814094 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.814187 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.814307 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:04.814434 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.814532 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:04.814567 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:04.814609 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:04.815867 32978 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0317 23:17:04.815994 32978 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0317 23:17:04.816041 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0317 23:17:04.816184 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:04.816161 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0317 23:17:04.816224 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0317 23:17:04.816242 32978 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0317 23:17:04.816250 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0317 23:17:04.816294 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0317 23:17:04.816241 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:04.816363 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.816472 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0317 23:17:04.816599 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0317 23:17:04.816641 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.816767 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:04.816845 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.816929 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] }] } I0317 23:17:04.817027 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:04.817055 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0317 23:17:04.817153 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:04.817190 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] }] } I0317 23:17:04.817277 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:04.817302 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0317 23:17:04.817389 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:04.817495 32978 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0317 23:17:04.817683 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0317 23:17:04.817758 32978 api.go:53] PageSize not implemented I0317 23:17:04.817786 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0317 23:17:04.817753 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:04.817842 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:04.817848 32978 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0317 23:17:04.817868 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0317 23:17:04.817898 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0317 23:17:04.817780 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:04.817969 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:04.817924 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0317 23:17:04.818018 32978 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0317 23:17:04.818065 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0317 23:17:04.818121 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0317 23:17:04.818157 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0317 23:17:04.818074 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0317 23:17:04.818237 32978 api.go:53] PageSize not implemented I0317 23:17:04.818255 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:04.818266 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:04.818500 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:04.818638 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:04.818774 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:04.818883 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:04.818962 32978 executor.go:111] Tasks: 120 done / 142 total; 6 can run I0317 23:17:04.819021 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0317 23:17:04.819043 32978 api.go:53] PageSize not implemented I0317 23:17:04.819055 32978 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0317 23:17:04.819057 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:04.819111 32978 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0317 23:17:04.819076 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:04.819098 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:04.819191 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0317 23:17:04.819234 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } W0317 23:17:04.819300 32978 api.go:53] PageSize not implemented I0317 23:17:04.819333 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:04.819384 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:04.823425 32978 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0317 23:17:04.823514 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:04.823640 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:04.823780 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:04.823841 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:04.823974 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:04.824387 32978 executor.go:111] Tasks: 134 done / 142 total; 2 can run W0317 23:17:04.824467 32978 api.go:53] PageSize not implemented I0317 23:17:04.824484 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:04.824643 32978 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0317 23:17:04.824816 32978 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0317 23:17:04.830673 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0317 23:17:04.830738 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:17:04.830772 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0317 23:17:04.830796 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0317 23:17:04.830822 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:04.830856 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0317 23:17:04.830876 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0317 23:17:04.830896 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:04.830916 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0317 23:17:04.830938 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0317 23:17:04.830960 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0317 23:17:04.830988 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0317 23:17:04.831012 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0317 23:17:04.831033 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:17:04.831053 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:17:04.831071 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:04.831094 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0317 23:17:04.831111 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0317 23:17:04.831131 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:04.831153 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:04.831173 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:04.831196 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0317 23:17:04.831216 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:04.831239 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:04.831259 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:04.831280 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:17:04.831299 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0317 23:17:04.831319 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:04.831341 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:04.831363 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:04.831384 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0317 23:17:04.832494 32978 delete_cluster.go:128] Looking for cloud resources to delete W0317 23:17:04.832541 32978 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0317 23:17:04.832555 32978 keypairs.go:95] DescribeKeyPairs: { } I0317 23:17:04.832582 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.832621 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0317 23:17:04.832664 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.832704 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.832734 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.832765 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.832793 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.832821 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0317 23:17:04.832860 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.832894 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:04.832915 32978 natgateway.go:117] DescribeNatGateways: { } I0317 23:17:04.832942 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0317 23:17:04.832968 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W0317 23:17:04.833003 32978 api.go:53] PageSize not implemented I0317 23:17:04.833015 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0317 23:17:04.833040 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:04.833058 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:04.833068 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0317 23:17:04.833094 32978 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0317 23:17:04.833110 32978 targetgroups.go:35] PageSize not implemented I0317 23:17:04.833122 32978 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" ] } I0317 23:17:04.833163 32978 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0317 23:17:04.833191 32978 iamrole.go:89] ListRoles: { } I0317 23:17:04.833224 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:04.833244 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:04.833275 32978 internetgateways.go:101] DescribeInternetGateways: { } I0317 23:17:04.833308 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:04.833336 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0317 23:17:04.833362 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0317 23:17:04.833385 32978 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0317 23:17:04.833936 32978 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0317 23:17:04.834025 32978 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } I0317 23:17:04.833892 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-config:lt-1 ok I0317 23:17:04.833993 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } autoscaling-group:bastion.privatecalico.example.com ok I0317 23:17:04.834093 32978 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I0317 23:17:04.834123 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok I0317 23:17:04.834091 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0317 23:17:04.834220 32978 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } load-balancer:api-privatecalico-example-0uch4k ok internet-gateway:igw-2 ok I0317 23:17:04.834231 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0317 23:17:04.834322 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0317 23:17:04.834351 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0317 23:17:04.834361 32978 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok route53-record:Z1AFAKE1ZON3YO/A/api.privatecalico.example.com ok I0317 23:17:04.834405 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I0317 23:17:04.834249 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0317 23:17:04.834455 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-group:nodes.privatecalico.example.com ok iam-instance-profile:nodes.privatecalico.example.com ok I0317 23:17:04.834476 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0317 23:17:04.834507 32978 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0317 23:17:04.834569 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0317 23:17:04.834615 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:04.834658 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W0317 23:17:04.834781 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:04.834798 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0317 23:17:04.834828 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-3 ok I0317 23:17:04.834876 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:04.834930 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W0317 23:17:04.835023 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:04.835042 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0317 23:17:04.835082 32978 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0317 23:17:04.835175 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I0317 23:17:04.835179 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0317 23:17:04.835209 32978 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I0317 23:17:04.835237 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0317 23:17:04.835272 32978 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I0317 23:17:04.835234 32978 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0317 23:17:04.835300 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I0317 23:17:04.835341 32978 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I0317 23:17:04.835353 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0317 23:17:04.835373 32978 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I0317 23:17:04.835341 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0317 23:17:04.835395 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I0317 23:17:04.835423 32978 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I0317 23:17:04.835433 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0317 23:17:04.835426 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:04.835451 32978 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I0317 23:17:04.835473 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W0317 23:17:04.835588 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:04.835600 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0317 23:17:04.835674 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0317 23:17:04.835726 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0317 23:17:04.835783 32978 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0317 23:17:04.835843 32978 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (3.19s) === RUN TestLifecyclePrivateKopeio I0317 23:17:04.836331 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:17:04.836564 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:17:04.836598 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:17:04.836633 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:17:04.836661 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:17:04.836699 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:17:04.836751 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:17:04.836779 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:17:04.836808 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:17:04.836831 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I0317 23:17:04.859093 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:04.861686 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:04.861743 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:04.861779 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:06.109141 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:06.249666 32978 iamrole.go:89] ListRoles: { } I0317 23:17:06.250876 32978 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0317 23:17:06.251245 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.251404 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0317 23:17:06.251436 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:06.251571 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:06.251535 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0317 23:17:06.252490 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:06.252794 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0317 23:17:06.251619 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.253009 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0317 23:17:06.253136 32978 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.253235 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatekopeio.example.com" }] } I0317 23:17:06.253297 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:17:06.253368 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.253360 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0317 23:17:06.253597 32978 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.254059 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0317 23:17:06.254097 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0317 23:17:06.254128 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:06.254180 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:06.254219 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:06.254419 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.254730 32978 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.255021 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:06.255298 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:06.258664 32978 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0317 23:17:06.258823 32978 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0317 23:17:06.258860 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.258929 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0317 23:17:06.258981 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0317 23:17:06.258972 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:06.259092 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0317 23:17:06.259139 32978 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0317 23:17:06.259063 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.259039 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0317 23:17:06.259179 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0317 23:17:06.259195 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.259240 32978 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0317 23:17:06.259338 32978 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0317 23:17:06.259292 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0317 23:17:06.259284 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0317 23:17:06.259357 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0317 23:17:06.259394 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0317 23:17:06.259459 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:06.259500 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:06.259529 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:06.259480 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0317 23:17:06.259562 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:06.259589 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0317 23:17:06.259661 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:06.259696 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:06.259729 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.259805 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0317 23:17:06.259897 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0317 23:17:06.259889 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0317 23:17:06.260082 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0317 23:17:06.260193 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.260329 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.260463 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0317 23:17:06.260602 32978 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0317 23:17:06.260606 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0317 23:17:06.260647 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.260579 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0317 23:17:06.260717 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:06.260778 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:06.260849 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0317 23:17:06.260891 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0317 23:17:06.260974 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:06.261015 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:06.261028 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0317 23:17:06.261084 32978 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I0317 23:17:06.261151 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }], VpcId: "vpc-1" } I0317 23:17:06.261216 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:06.261254 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:06.261284 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0317 23:17:06.261341 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0317 23:17:06.261371 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0317 23:17:06.261409 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0317 23:17:06.261441 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0317 23:17:06.261468 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0317 23:17:06.261564 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0317 23:17:06.261593 32978 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.261668 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:06.261722 32978 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0317 23:17:06.261760 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:06.261802 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0317 23:17:06.261835 32978 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0317 23:17:06.261900 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0317 23:17:06.261670 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0317 23:17:06.261931 32978 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0317 23:17:06.261987 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0317 23:17:06.262021 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:06.262099 32978 executor.go:111] Tasks: 81 done / 144 total; 41 can run W0317 23:17:06.262205 32978 api.go:53] PageSize not implemented I0317 23:17:06.262249 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.262323 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:06.262396 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:06.262379 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:06.262358 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:06.262467 32978 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "api.privatekopeio.example.com" }] } I0317 23:17:06.262503 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0317 23:17:06.262521 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:06.262481 32978 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-2" },{ SubnetId: "subnet-3" }], Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.privatekopeio.example.com" }], Type: "network" } I0317 23:17:06.262559 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:06.262550 32978 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0317 23:17:06.262587 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:06.262591 32978 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0317 23:17:06.262625 32978 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W0317 23:17:06.262690 32978 api.go:53] PageSize not implemented I0317 23:17:06.262706 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:06.262623 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.262753 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.262859 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0317 23:17:06.262967 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0317 23:17:06.263002 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-4" } I0317 23:17:06.263086 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0317 23:17:06.263217 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.263366 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.263499 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:06.263551 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:06.263602 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:06.263665 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:06.263722 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0317 23:17:06.263786 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0317 23:17:06.263836 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.263947 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.264049 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.264153 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0317 23:17:06.264195 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0317 23:17:06.264269 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.264365 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0317 23:17:06.264403 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0317 23:17:06.264430 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0317 23:17:06.264455 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0317 23:17:06.264488 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0317 23:17:06.264609 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" }] }] } I0317 23:17:06.264724 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.264826 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0317 23:17:06.264929 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.265026 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.265126 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0317 23:17:06.265222 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0317 23:17:06.265262 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0317 23:17:06.265291 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.265388 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0317 23:17:06.265459 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0317 23:17:06.265528 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I0317 23:17:06.265599 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:17:06.265640 32978 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0317 23:17:06.265671 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0317 23:17:06.265701 32978 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0317 23:17:06.265729 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0317 23:17:06.265824 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0317 23:17:06.265932 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:17:06.265969 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:06.266043 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0317 23:17:06.266146 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } I0317 23:17:06.266242 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0317 23:17:06.266287 32978 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0317 23:17:06.266316 32978 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0317 23:17:06.266346 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:06.266376 32978 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0317 23:17:06.266404 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0317 23:17:06.266439 32978 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0317 23:17:06.266468 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:06.266570 32978 executor.go:111] Tasks: 122 done / 144 total; 7 can run I0317 23:17:06.266650 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0317 23:17:06.266693 32978 api.go:53] PageSize not implemented I0317 23:17:06.266772 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:06.266646 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0317 23:17:06.266758 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:06.266868 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0317 23:17:06.266893 32978 api.go:53] PageSize not implemented I0317 23:17:06.266891 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-3" } I0317 23:17:06.266930 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:06.266937 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:06.266933 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:06.267033 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-2" } I0317 23:17:06.270954 32978 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0317 23:17:06.271080 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:06.271164 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:06.271313 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:06.271414 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:06.271739 32978 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0317 23:17:06.271908 32978 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0317 23:17:06.272060 32978 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0317 23:17:06.272089 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:06.272112 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:06.272152 32978 dns.go:235] Pre-creating DNS records I0317 23:17:06.272169 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:06.276874 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:06.279613 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:06.279675 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:06.279716 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:07.528898 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:07.680919 32978 iamrole.go:89] ListRoles: { } I0317 23:17:07.682412 32978 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0317 23:17:07.682841 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.682912 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:07.683006 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.683110 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:07.683216 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.683323 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.683461 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:07.683489 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:07.683530 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:07.685625 32978 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0317 23:17:07.685727 32978 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0317 23:17:07.685775 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:07.685909 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.686025 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0317 23:17:07.686056 32978 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0317 23:17:07.686063 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0317 23:17:07.686058 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0317 23:17:07.686223 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:07.686138 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0317 23:17:07.686276 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0317 23:17:07.686270 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.686373 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.686479 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:07.686508 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.686607 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.686692 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0317 23:17:07.686845 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:07.686880 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0317 23:17:07.686974 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0317 23:17:07.687013 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:07.687081 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.687173 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:07.687199 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.687288 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:07.687313 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0317 23:17:07.687406 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:07.687446 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.687530 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0317 23:17:07.687603 32978 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0317 23:17:07.687777 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:07.687860 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } W0317 23:17:07.687925 32978 api.go:53] PageSize not implemented I0317 23:17:07.687878 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:07.687985 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:07.687952 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:07.688007 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0317 23:17:07.688027 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:07.688041 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0317 23:17:07.688055 32978 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0317 23:17:07.688067 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0317 23:17:07.687930 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:07.688095 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0317 23:17:07.688123 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } W0317 23:17:07.688189 32978 api.go:53] PageSize not implemented I0317 23:17:07.688205 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:07.688219 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0317 23:17:07.688347 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:07.688471 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0317 23:17:07.688561 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:07.688635 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:07.688713 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:07.688949 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:07.689078 32978 executor.go:111] Tasks: 122 done / 144 total; 7 can run I0317 23:17:07.689140 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0317 23:17:07.689174 32978 api.go:53] PageSize not implemented I0317 23:17:07.689176 32978 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0317 23:17:07.689189 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:07.689232 32978 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0317 23:17:07.689226 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:07.689220 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0317 23:17:07.689297 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:07.689373 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } W0317 23:17:07.689479 32978 api.go:53] PageSize not implemented I0317 23:17:07.689515 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:07.689579 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:07.693469 32978 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0317 23:17:07.693565 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:07.693680 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:07.693733 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:07.693845 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:07.694412 32978 executor.go:111] Tasks: 136 done / 144 total; 2 can run W0317 23:17:07.694496 32978 api.go:53] PageSize not implemented I0317 23:17:07.694512 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:07.694666 32978 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0317 23:17:07.694851 32978 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0317 23:17:07.697382 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0317 23:17:07.697435 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:17:07.697468 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0317 23:17:07.697492 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:07.697515 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0317 23:17:07.697537 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0317 23:17:07.697562 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:07.697586 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0317 23:17:07.697611 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0317 23:17:07.697636 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0317 23:17:07.697663 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0317 23:17:07.697699 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:17:07.697723 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:17:07.697747 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:07.697771 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0317 23:17:07.697793 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0317 23:17:07.697818 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0317 23:17:07.697844 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:07.697869 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:07.697893 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:07.697917 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0317 23:17:07.697940 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:07.697967 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:07.697990 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:07.698015 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0317 23:17:07.698040 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0317 23:17:07.698065 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:17:07.698087 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0317 23:17:07.698110 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:07.698138 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:07.698165 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:07.698189 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0317 23:17:07.699403 32978 delete_cluster.go:128] Looking for cloud resources to delete W0317 23:17:07.699459 32978 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0317 23:17:07.699474 32978 keypairs.go:95] DescribeKeyPairs: { } I0317 23:17:07.699507 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.699552 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0317 23:17:07.699599 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.699645 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.699678 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.699715 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.699745 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.699781 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0317 23:17:07.699830 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.699880 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:07.699906 32978 natgateway.go:117] DescribeNatGateways: { } I0317 23:17:07.699935 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0317 23:17:07.699964 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W0317 23:17:07.700003 32978 api.go:53] PageSize not implemented I0317 23:17:07.700019 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0317 23:17:07.700049 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:07.700085 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:07.700099 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0317 23:17:07.700130 32978 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0317 23:17:07.700148 32978 targetgroups.go:35] PageSize not implemented I0317 23:17:07.700160 32978 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0317 23:17:07.700203 32978 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0317 23:17:07.700236 32978 iamrole.go:89] ListRoles: { } I0317 23:17:07.700277 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:07.700299 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:07.700330 32978 internetgateways.go:101] DescribeInternetGateways: { } I0317 23:17:07.700368 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:07.700409 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2","rtb-3"] } I0317 23:17:07.700441 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0317 23:17:07.700463 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } autoscaling-group:bastion.privatekopeio.example.com ok I0317 23:17:07.700979 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I0317 23:17:07.701059 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok I0317 23:17:07.701057 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0317 23:17:07.700980 32978 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0317 23:17:07.701120 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } I0317 23:17:07.701133 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } volume:vol-2 ok autoscaling-config:lt-1 ok I0317 23:17:07.701156 32978 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0317 23:17:07.701195 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok iam-instance-profile:nodes.privatekopeio.example.com ok I0317 23:17:07.701213 32978 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0317 23:17:07.701235 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } autoscaling-group:nodes.privatekopeio.example.com ok I0317 23:17:07.701287 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0317 23:17:07.701266 32978 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } iam-instance-profile:masters.privatekopeio.example.com ok I0317 23:17:07.701319 32978 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-3 ok I0317 23:17:07.701369 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok internet-gateway:igw-2 ok autoscaling-config:lt-2 ok I0317 23:17:07.701376 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:07.701522 32978 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.privatekopeio.example.com. ok I0317 23:17:07.701411 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } load-balancer:api-privatekopeio-example-tl2bv8 ok W0317 23:17:07.701580 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:07.701602 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0317 23:17:07.701627 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:07.701662 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W0317 23:17:07.701740 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:07.701752 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0317 23:17:07.701772 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0317 23:17:07.701805 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 } ] } W0317 23:17:07.701921 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:07.701931 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0317 23:17:07.702006 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I0317 23:17:07.702042 32978 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0317 23:17:07.702030 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0317 23:17:07.702056 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0317 23:17:07.702084 32978 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I0317 23:17:07.702090 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0317 23:17:07.702110 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I0317 23:17:07.702124 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:07.702146 32978 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0317 23:17:07.702167 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } W0317 23:17:07.702248 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:07.702235 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0317 23:17:07.702260 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0317 23:17:07.702269 32978 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I0317 23:17:07.702290 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0317 23:17:07.702296 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I0317 23:17:07.702332 32978 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I0317 23:17:07.702342 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0317 23:17:07.702343 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0317 23:17:07.702362 32978 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I0317 23:17:07.702439 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0317 23:17:07.702491 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0317 23:17:07.702538 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0317 23:17:07.702595 32978 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0317 23:17:07.702653 32978 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (2.87s) === RUN TestLifecycleIPv6 I0317 23:17:07.703109 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:17:07.703319 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:17:07.703348 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:17:07.703382 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:17:07.703442 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:17:07.703478 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:17:07.703509 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:17:07.703531 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:17:07.703557 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:17:07.703578 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I0317 23:17:07.731093 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:17:07.734163 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:07.734252 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:08.959848 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:09.102166 32978 iamrole.go:89] ListRoles: { } I0317 23:17:09.105077 32978 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0317 23:17:09.105269 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:09.105307 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.105478 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:09.105667 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:09.105739 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.105954 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0317 23:17:09.105948 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:09.106055 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0317 23:17:09.106115 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:09.106217 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.106398 32978 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.106541 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:17:09.106440 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0317 23:17:09.106615 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0317 23:17:09.106824 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.106988 32978 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.107011 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:09.107183 32978 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.107313 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0317 23:17:09.107358 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0317 23:17:09.107387 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:09.107429 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:09.107946 32978 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0317 23:17:09.108097 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0317 23:17:09.108045 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0317 23:17:09.108187 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0317 23:17:09.108194 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0317 23:17:09.108191 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:09.108261 32978 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0317 23:17:09.108313 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0317 23:17:09.108285 32978 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0317 23:17:09.108277 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.108343 32978 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0317 23:17:09.108376 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0317 23:17:09.108474 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0317 23:17:09.108461 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0317 23:17:09.108581 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0317 23:17:09.108646 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0317 23:17:09.108723 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:09.108764 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:09.108793 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.108871 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0317 23:17:09.108954 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0317 23:17:09.108952 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0317 23:17:09.109116 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0317 23:17:09.109189 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:09.109226 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:09.109255 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0317 23:17:09.109315 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:09.109345 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:09.109371 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:09.109509 32978 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0317 23:17:09.109543 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.109615 32978 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0317 23:17:09.109652 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.109722 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.109803 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0317 23:17:09.109839 32978 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0317 23:17:09.109929 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:09.109966 32978 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0317 23:17:09.110019 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0317 23:17:09.110105 32978 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.110166 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:09.110203 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0317 23:17:09.110000 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0317 23:17:09.110296 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0317 23:17:09.110351 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0317 23:17:09.110381 32978 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" } ] } I0317 23:17:09.110483 32978 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0317 23:17:09.110607 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.110694 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.110742 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0317 23:17:09.110826 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:09.110862 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:09.110889 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0317 23:17:09.110884 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0317 23:17:09.111002 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:09.111044 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:09.111135 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0317 23:17:09.111244 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I0317 23:17:09.111287 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.111392 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.111522 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0317 23:17:09.111604 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0317 23:17:09.111642 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:09.111670 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.111771 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I0317 23:17:09.111915 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.112014 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0317 23:17:09.112104 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.112169 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.112244 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0317 23:17:09.112255 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:09.112378 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:09.112327 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0317 23:17:09.112415 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0317 23:17:09.112448 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:09.112544 32978 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0317 23:17:09.112519 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0317 23:17:09.112584 32978 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0317 23:17:09.112707 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.112845 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0317 23:17:09.112949 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I0317 23:17:09.112993 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:09.113047 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.113166 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0317 23:17:09.113202 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0317 23:17:09.113239 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.113389 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0317 23:17:09.113533 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.113650 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.113773 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" }] }] } I0317 23:17:09.113893 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.114010 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0317 23:17:09.114149 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0317 23:17:09.114194 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0317 23:17:09.114249 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0317 23:17:09.114364 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:09.114445 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.114560 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I0317 23:17:09.114616 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0317 23:17:09.114722 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0317 23:17:09.114770 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0317 23:17:09.114817 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0317 23:17:09.114922 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-1" } I0317 23:17:09.114987 32978 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0317 23:17:09.115063 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:09.115155 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:09.115158 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0317 23:17:09.115288 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } W0317 23:17:09.115322 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:09.115321 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0317 23:17:09.115354 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I0317 23:17:09.115389 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-5" } I0317 23:17:09.115420 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:09.115481 32978 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-6"] }] } I0317 23:17:09.115434 32978 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-6" },{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I0317 23:17:09.115526 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0317 23:17:09.115560 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:09.115570 32978 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-6", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0317 23:17:09.115599 32978 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I0317 23:17:09.115640 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0317 23:17:09.115672 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0317 23:17:09.115671 32978 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0317 23:17:09.115704 32978 tags.go:42] CreateTags { Resources: ["subnet-6"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } W0317 23:17:09.115724 32978 api.go:53] PageSize not implemented I0317 23:17:09.115741 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:09.115836 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0317 23:17:09.115861 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I0317 23:17:09.115894 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0317 23:17:09.115981 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I0317 23:17:09.116006 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-6" } I0317 23:17:09.116029 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:09.116079 32978 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:09.116147 32978 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0317 23:17:09.116155 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:09.116289 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0317 23:17:09.116338 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0317 23:17:09.116375 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:09.116407 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0317 23:17:09.116469 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0317 23:17:09.116507 32978 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I0317 23:17:09.116541 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0317 23:17:09.116586 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I0317 23:17:09.116643 32978 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0317 23:17:09.116720 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:09.116708 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:09.116763 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:09.116833 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:09.116785 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:09.116818 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:09.116917 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:09.116857 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0317 23:17:09.116970 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:09.117019 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:09.116976 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:09.117035 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0317 23:17:09.116965 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I0317 23:17:09.117123 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I0317 23:17:09.117195 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:09.117372 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:09.117474 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0317 23:17:09.117527 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0317 23:17:09.121325 32978 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0317 23:17:09.121509 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:09.121609 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:09.121684 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:09.121782 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:09.122155 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:17:09.122361 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:17:09.122586 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0317 23:17:09.122623 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:09.122654 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:09.122706 32978 dns.go:235] Pre-creating DNS records I0317 23:17:09.122726 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:09.127630 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0317 23:17:09.130478 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:09.130540 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:10.113713 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:10.287990 32978 iamrole.go:89] ListRoles: { } I0317 23:17:10.289317 32978 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0317 23:17:10.289543 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:10.289572 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.289726 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.289913 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:10.290059 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.290165 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:10.290190 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:10.290229 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:10.290255 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] }] } I0317 23:17:10.295618 32978 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0317 23:17:10.295749 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.295844 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0317 23:17:10.295945 32978 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0317 23:17:10.295909 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0317 23:17:10.296044 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:10.296013 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0317 23:17:10.296098 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0317 23:17:10.296087 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.296139 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0317 23:17:10.296199 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:10.296762 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:10.296882 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0317 23:17:10.297009 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:10.297078 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.297253 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.297356 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.297450 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0317 23:17:10.297576 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:10.297938 32978 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0317 23:17:10.298049 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] }] } I0317 23:17:10.298185 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:10.298285 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0317 23:17:10.298322 32978 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0317 23:17:10.298353 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0317 23:17:10.298499 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.298622 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0317 23:17:10.298653 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:10.298745 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.298856 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0317 23:17:10.298886 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.298989 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0317 23:17:10.299058 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0317 23:17:10.299147 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:10.299257 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:10.299315 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0317 23:17:10.299344 32978 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0317 23:17:10.299370 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0317 23:17:10.299405 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.299495 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:10.299523 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0317 23:17:10.299591 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] }] } I0317 23:17:10.299708 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:10.299737 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:10.299796 32978 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0317 23:17:10.299861 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:10.299902 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:10.299983 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:10.299934 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:10.299999 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0317 23:17:10.300032 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0317 23:17:10.300030 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0317 23:17:10.300080 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0317 23:17:10.300147 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0317 23:17:10.300194 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0317 23:17:10.300211 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:10.300292 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:10.300364 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0317 23:17:10.300431 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:10.300242 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0317 23:17:10.300497 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W0317 23:17:10.300549 32978 api.go:53] PageSize not implemented I0317 23:17:10.300560 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:10.300652 32978 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0317 23:17:10.300722 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:10.300703 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0317 23:17:10.300780 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0317 23:17:10.300797 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:10.300803 32978 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0317 23:17:10.300766 32978 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0317 23:17:10.300728 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:10.300819 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0317 23:17:10.300872 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:10.300948 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:10.300984 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:10.301010 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:10.301028 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0317 23:17:10.301100 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:10.301125 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0317 23:17:10.301195 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:10.301241 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:10.301255 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0317 23:17:10.306012 32978 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0317 23:17:10.306115 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:10.306277 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:10.306425 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:10.306559 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:10.307444 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:17:10.307658 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:17:10.307830 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0317 23:17:10.310474 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0317 23:17:10.310528 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:17:10.310560 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0317 23:17:10.310584 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I0317 23:17:10.310608 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0317 23:17:10.310631 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:10.310654 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0317 23:17:10.310677 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0317 23:17:10.310700 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0317 23:17:10.310722 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:10.310748 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0317 23:17:10.310774 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0317 23:17:10.310803 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0317 23:17:10.310832 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0317 23:17:10.310857 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0317 23:17:10.310882 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:17:10.310905 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:17:10.310926 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:10.310952 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0317 23:17:10.310974 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0317 23:17:10.310997 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0317 23:17:10.311023 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:10.311048 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:10.311071 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:10.311100 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:10.311129 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:10.311154 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:10.311179 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0317 23:17:10.311204 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0317 23:17:10.311228 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0317 23:17:10.311254 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0317 23:17:10.311281 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:17:10.311303 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0317 23:17:10.311326 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:10.311352 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:10.311377 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:10.311404 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0317 23:17:10.312999 32978 delete_cluster.go:128] Looking for cloud resources to delete W0317 23:17:10.313053 32978 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0317 23:17:10.313070 32978 keypairs.go:95] DescribeKeyPairs: { } I0317 23:17:10.313104 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.313146 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0317 23:17:10.313191 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.313235 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.313272 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.313310 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.313346 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.313383 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0317 23:17:10.313455 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.313524 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:10.313551 32978 natgateway.go:117] DescribeNatGateways: { } I0317 23:17:10.313592 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0317 23:17:10.313625 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W0317 23:17:10.313670 32978 api.go:53] PageSize not implemented I0317 23:17:10.313685 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:10.313706 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:10.313719 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0317 23:17:10.313755 32978 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0317 23:17:10.313775 32978 targetgroups.go:35] PageSize not implemented I0317 23:17:10.313788 32978 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0317 23:17:10.313837 32978 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0317 23:17:10.313868 32978 iamrole.go:89] ListRoles: { } I0317 23:17:10.313908 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:10.313932 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:10.313965 32978 internetgateways.go:101] DescribeInternetGateways: { } I0317 23:17:10.314003 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:10.314045 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2","rtb-3"] } I0317 23:17:10.314082 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0317 23:17:10.314112 32978 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0317 23:17:10.314137 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0317 23:17:10.314163 32978 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0317 23:17:10.314708 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0317 23:17:10.314738 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok autoscaling-group:nodes.minimal-ipv6.example.com ok I0317 23:17:10.314824 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } I0317 23:17:10.314779 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } security-group:sg-2 ok iam-instance-profile:nodes.minimal-ipv6.example.com ok I0317 23:17:10.314701 32978 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I0317 23:17:10.314857 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0317 23:17:10.314884 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0317 23:17:10.314896 32978 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0317 23:17:10.314906 32978 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I0317 23:17:10.314954 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } nat-gateway:nat-2 ok iam-instance-profile:masters.minimal-ipv6.example.com ok autoscaling-config:lt-2 ok I0317 23:17:10.314986 32978 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0317 23:17:10.315040 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:10.314810 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/kops-controller.internal.minimal-ipv6.example.com. ok I0317 23:17:10.315094 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 } ] } W0317 23:17:10.315319 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:10.315336 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0317 23:17:10.315361 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0317 23:17:10.315405 32978 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I0317 23:17:10.315454 32978 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0317 23:17:10.315501 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok I0317 23:17:10.315561 32978 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0317 23:17:10.315643 32978 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0317 23:17:10.315678 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I0317 23:17:10.315743 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0317 23:17:10.315799 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:10.315844 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0317 23:17:10.315946 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:10.315958 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0317 23:17:10.316044 32978 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I0317 23:17:10.316053 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I0317 23:17:10.316135 32978 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0317 23:17:10.316115 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0317 23:17:10.316156 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0317 23:17:10.316196 32978 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } I0317 23:17:10.316187 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } iam-role:nodes.minimal-ipv6.example.com ok subnet:subnet-3 ok I0317 23:17:10.316243 32978 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0317 23:17:10.316258 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I0317 23:17:10.316322 32978 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0317 23:17:10.316317 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } I0317 23:17:10.316335 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } subnet:subnet-5 ok I0317 23:17:10.316361 32978 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I0317 23:17:10.316371 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0317 23:17:10.316443 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0317 23:17:10.316506 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0317 23:17:10.316584 32978 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0317 23:17:10.316662 32978 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (2.61s) === RUN TestLifecycleSharedVPC I0317 23:17:10.317176 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:17:10.317406 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:17:10.317439 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:17:10.317472 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:17:10.317501 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:17:10.317538 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:17:10.317573 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:17:10.317597 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:17:10.317625 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:17:10.317647 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I0317 23:17:10.336198 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:10.338696 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:10.338833 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:11.588232 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:11.730193 32978 iamrole.go:89] ListRoles: { } I0317 23:17:11.731149 32978 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0317 23:17:11.731337 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:17:11.731412 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0317 23:17:11.731442 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0317 23:17:11.731672 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0317 23:17:11.731804 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0317 23:17:11.732041 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:11.732173 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:11.732337 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:11.732372 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:11.732449 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:11.732496 32978 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0317 23:17:11.732662 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I0317 23:17:11.732623 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:11.732749 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0317 23:17:11.732868 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:11.733035 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:11.734311 32978 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0317 23:17:11.734458 32978 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0317 23:17:11.734506 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0317 23:17:11.734514 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:11.734575 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0317 23:17:11.734620 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0317 23:17:11.734682 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0317 23:17:11.734796 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0317 23:17:11.734759 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:17:11.734879 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0317 23:17:11.734937 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0317 23:17:11.735058 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0317 23:17:11.735139 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:11.735180 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:11.735218 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:11.735303 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0317 23:17:11.735394 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0317 23:17:11.735409 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:11.735478 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:11.735508 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }], VpcId: "vpc-12345678" } I0317 23:17:11.735573 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:11.735611 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:11.735652 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:11.735700 32978 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0317 23:17:11.736287 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0317 23:17:11.738813 32978 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0317 23:17:11.738913 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:11.739030 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0317 23:17:11.739101 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:11.739218 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0317 23:17:11.739258 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0317 23:17:11.739293 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0317 23:17:11.739415 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0317 23:17:11.739599 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:11.739695 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:11.739776 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0317 23:17:11.739931 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:11.740046 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:11.740248 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0317 23:17:11.740448 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0317 23:17:11.740560 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:11.740622 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0317 23:17:11.740722 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0317 23:17:11.740822 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0317 23:17:11.740916 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" }] }] } I0317 23:17:11.741013 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0317 23:17:11.741110 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0317 23:17:11.741204 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0317 23:17:11.741318 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0317 23:17:11.741360 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0317 23:17:11.741456 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" }] }] } I0317 23:17:11.741566 32978 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0317 23:17:11.741747 32978 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0317 23:17:11.741943 32978 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0317 23:17:11.741985 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:11.742017 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:11.742073 32978 dns.go:235] Pre-creating DNS records I0317 23:17:11.742098 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:11.746461 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:11.749022 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:11.749086 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:12.977362 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:13.117309 32978 iamrole.go:89] ListRoles: { } I0317 23:17:13.118348 32978 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0317 23:17:13.118707 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:13.118839 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.119633 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:13.120024 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.120859 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:17:13.120934 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0317 23:17:13.120957 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0317 23:17:13.122376 32978 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0317 23:17:13.122549 32978 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0317 23:17:13.122478 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0317 23:17:13.122603 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0317 23:17:13.122640 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:17:13.122765 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0317 23:17:13.122893 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:13.122973 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.123106 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:13.123166 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.123261 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:13.126701 32978 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0317 23:17:13.126887 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:13.126996 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:13.127141 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:13.127248 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:13.127402 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:13.127694 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:13.127843 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:13.128213 32978 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0317 23:17:13.128397 32978 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0317 23:17:13.128560 32978 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0317 23:17:13.130478 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0317 23:17:13.130527 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0317 23:17:13.130552 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:13.130573 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0317 23:17:13.130594 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0317 23:17:13.130614 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0317 23:17:13.130646 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0317 23:17:13.130673 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0317 23:17:13.130700 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:17:13.130722 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:17:13.130742 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:13.130765 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0317 23:17:13.130785 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:13.130806 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:13.130828 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:13.130851 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:13.130870 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:17:13.130890 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0317 23:17:13.130909 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:13.130931 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:13.130955 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0317 23:17:13.131936 32978 delete_cluster.go:128] Looking for cloud resources to delete W0317 23:17:13.131990 32978 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0317 23:17:13.132004 32978 keypairs.go:95] DescribeKeyPairs: { } I0317 23:17:13.132033 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.132069 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0317 23:17:13.132108 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.132148 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.132177 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.132205 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.132233 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.132257 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0317 23:17:13.132289 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.132328 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0317 23:17:13.132352 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W0317 23:17:13.132385 32978 api.go:53] PageSize not implemented I0317 23:17:13.132401 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:13.132420 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:13.132435 32978 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0317 23:17:13.132452 32978 targetgroups.go:35] PageSize not implemented I0317 23:17:13.132466 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0317 23:17:13.132501 32978 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0317 23:17:13.132527 32978 iamrole.go:89] ListRoles: { } I0317 23:17:13.132559 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:13.132581 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:13.132615 32978 internetgateways.go:101] DescribeInternetGateways: { } I0317 23:17:13.132644 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:13.132664 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-config:lt-1 ok I0317 23:17:13.132955 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0317 23:17:13.133000 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } iam-instance-profile:masters.sharedvpc.example.com ok autoscaling-group:nodes.sharedvpc.example.com ok I0317 23:17:13.133018 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I0317 23:17:13.133082 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:13.133184 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0317 23:17:13.133160 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0317 23:17:13.133274 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:13.133291 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0317 23:17:13.133246 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok I0317 23:17:13.133103 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedvpc.example.com. ok I0317 23:17:13.133331 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:13.133366 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0317 23:17:13.133535 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:13.133554 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0317 23:17:13.133583 32978 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0317 23:17:13.133635 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0317 23:17:13.133714 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I0317 23:17:13.133755 32978 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0317 23:17:13.133731 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0317 23:17:13.133776 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I0317 23:17:13.133839 32978 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I0317 23:17:13.133854 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0317 23:17:13.133880 32978 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I0317 23:17:13.133906 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0317 23:17:13.133926 32978 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I0317 23:17:13.133983 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (2.82s) === RUN TestLifecycleComplex I0317 23:17:13.134456 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:17:13.134664 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:17:13.134693 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:17:13.134726 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:17:13.134754 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:17:13.134787 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:17:13.134817 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:17:13.134837 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:17:13.134862 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:17:13.134882 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I0317 23:17:13.164810 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:17:13.167951 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:13.168018 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:14.383854 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:14.536255 32978 iamrole.go:89] ListRoles: { } I0317 23:17:14.537544 32978 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0317 23:17:14.537756 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0317 23:17:14.537887 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0317 23:17:14.537951 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0317 23:17:14.538035 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" } ] } I0317 23:17:14.538015 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0317 23:17:14.538162 32978 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" } ] }] } I0317 23:17:14.538250 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } W0317 23:17:14.538333 32978 api.go:53] PageSize not implemented I0317 23:17:14.538587 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:14.538748 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:14.538908 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:14.538953 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0317 23:17:14.539013 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:14.539165 32978 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0317 23:17:14.539165 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0317 23:17:14.539238 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0317 23:17:14.539263 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0317 23:17:14.539241 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] } I0317 23:17:14.539280 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:14.539323 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:14.539396 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:14.539475 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:14.539586 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:14.539616 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0317 23:17:14.539693 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:14.542445 32978 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0317 23:17:14.542649 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0317 23:17:14.542683 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0317 23:17:14.542927 32978 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0317 23:17:14.542940 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:14.543105 32978 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0317 23:17:14.543195 32978 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0317 23:17:14.543255 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0317 23:17:14.543360 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0317 23:17:14.543245 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:14.543504 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:14.543695 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0317 23:17:14.543703 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0317 23:17:14.543781 32978 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0317 23:17:14.543772 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0317 23:17:14.543838 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0317 23:17:14.543841 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0317 23:17:14.543989 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:14.544038 32978 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0317 23:17:14.544230 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:14.544401 32978 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0317 23:17:14.544476 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:14.545044 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0317 23:17:14.545111 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }], VpcId: "vpc-1" } I0317 23:17:14.545195 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:14.545005 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0317 23:17:14.545241 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:14.545164 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0317 23:17:14.545295 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:14.545332 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:14.545360 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:14.545499 32978 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I0317 23:17:14.545544 32978 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0317 23:17:14.545569 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:14.545627 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:14.545702 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0317 23:17:14.545771 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0317 23:17:14.546334 32978 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" } ] }] } I0317 23:17:14.546413 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0317 23:17:14.546505 32978 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I0317 23:17:14.546539 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:14.546576 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" } ] }], VpcId: "vpc-1" } I0317 23:17:14.546666 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:14.546713 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:14.546767 32978 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] } I0317 23:17:14.546868 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }], VpcId: "vpc-1" } I0317 23:17:14.546943 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:14.546980 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:14.547047 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:14.547084 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0317 23:17:14.546941 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0317 23:17:14.547115 32978 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0317 23:17:14.547232 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:14.547275 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:14.547346 32978 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0317 23:17:14.547454 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:14.547591 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0317 23:17:14.547603 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0317 23:17:14.547720 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0317 23:17:14.547762 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:14.547871 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:14.548003 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0317 23:17:14.548103 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0317 23:17:14.548232 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0317 23:17:14.548265 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0317 23:17:14.548297 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I0317 23:17:14.548424 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I0317 23:17:14.548561 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0317 23:17:14.548634 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0317 23:17:14.548749 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" } ] }] } I0317 23:17:14.548856 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0317 23:17:14.548975 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0317 23:17:14.549086 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:14.549174 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:14.549242 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" } ] }] } I0317 23:17:14.549356 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I0317 23:17:14.549433 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" } ] }] } I0317 23:17:14.549536 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:14.549570 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0317 23:17:14.549674 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0317 23:17:14.549776 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:14.549829 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:14.549887 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-1", TransitGatewayId: "tgw-123456" } I0317 23:17:14.549939 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-1", TransitGatewayId: "tgw-0123456" } I0317 23:17:14.550007 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I0317 23:17:14.550135 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I0317 23:17:14.550256 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0317 23:17:14.550368 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0317 23:17:14.550405 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0317 23:17:14.550434 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0317 23:17:14.550508 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" } ] }] } I0317 23:17:14.550614 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0317 23:17:14.550716 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0317 23:17:14.550788 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" } ] }] } I0317 23:17:14.550893 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I0317 23:17:14.550962 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0317 23:17:14.551064 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0317 23:17:14.551167 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0317 23:17:14.551205 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0317 23:17:14.551319 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0317 23:17:14.551448 32978 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0317 23:17:14.551505 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:14.551528 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:14.551597 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:14.551609 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0317 23:17:14.552035 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0317 23:17:14.552067 32978 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-2" }], Tags: [ { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], Type: "network" } I0317 23:17:14.552153 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:14.552198 32978 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0317 23:17:14.552265 32978 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0317 23:17:14.552315 32978 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0317 23:17:14.552370 32978 api.go:53] PageSize not implemented I0317 23:17:14.552412 32978 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0317 23:17:14.552455 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:14.552494 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:14.552504 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:14.552509 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:14.552561 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:14.552634 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:14.552704 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:14.552664 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:14.552720 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:14.552774 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:14.557324 32978 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0317 23:17:14.557469 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:14.557562 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:14.557725 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:14.557834 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:14.558460 32978 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0317 23:17:14.558691 32978 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0317 23:17:14.558924 32978 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0317 23:17:14.558965 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:14.558995 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:14.559049 32978 dns.go:235] Pre-creating DNS records I0317 23:17:14.559069 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:14.565116 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:17:14.568366 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:14.568430 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:15.815320 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:15.967450 32978 iamrole.go:89] ListRoles: { } I0317 23:17:15.968896 32978 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0317 23:17:15.969105 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:15.969181 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W0317 23:17:15.969275 32978 api.go:53] PageSize not implemented I0317 23:17:15.969384 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0317 23:17:15.969544 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0317 23:17:15.969659 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:15.969818 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0317 23:17:15.969924 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:15.970096 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:15.970233 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:15.970326 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:15.970365 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:15.970443 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:15.971356 32978 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0317 23:17:15.971490 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:15.971524 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0317 23:17:15.971603 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:15.971638 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0317 23:17:15.971610 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:15.971672 32978 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0317 23:17:15.971711 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0317 23:17:15.971726 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:15.971807 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:15.971864 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0317 23:17:15.971858 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0317 23:17:15.971983 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:15.972015 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0317 23:17:15.972028 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:15.972135 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0317 23:17:15.972244 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:15.972276 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:15.972315 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:15.972387 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:15.972446 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:15.972500 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0317 23:17:15.972618 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:15.972663 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:15.972767 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:15.972877 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:15.973686 32978 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0317 23:17:15.973867 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:15.974007 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:15.974147 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:15.974487 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:15.974558 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:15.974746 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:15.974863 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:15.974918 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:15.975062 32978 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0317 23:17:15.975129 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:15.975182 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:15.975197 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:15.975157 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:15.975228 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:15.975255 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0317 23:17:15.975283 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:15.975310 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:15.975331 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0317 23:17:15.975401 32978 api.go:53] PageSize not implemented I0317 23:17:15.975438 32978 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0317 23:17:15.975475 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:15.975509 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:15.975529 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:15.975523 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:15.975572 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:15.975592 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:15.975583 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:15.975631 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:15.975613 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:15.975695 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:15.975736 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:15.975754 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:15.975845 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:15.975872 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:15.979806 32978 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0317 23:17:15.979893 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:15.980023 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:15.980093 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:15.980227 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:15.980704 32978 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0317 23:17:15.980872 32978 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0317 23:17:15.981081 32978 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I0317 23:17:15.985576 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:15.988285 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:15.997586 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:17:16.000738 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:16.000800 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:17.276725 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:17.433661 32978 iamrole.go:89] ListRoles: { } I0317 23:17:17.435177 32978 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0317 23:17:17.435460 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0317 23:17:17.435598 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0317 23:17:17.435649 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:17.435723 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0317 23:17:17.435832 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:17.435933 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:17.435959 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:17.436007 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:17.436037 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:17.436141 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0317 23:17:17.436228 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0317 23:17:17.436392 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0317 23:17:17.436657 32978 api.go:53] PageSize not implemented I0317 23:17:17.437744 32978 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0317 23:17:17.437867 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:17.437885 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0317 23:17:17.437958 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:17.437948 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:17.437988 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0317 23:17:17.438039 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0317 23:17:17.438090 32978 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0317 23:17:17.438040 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0317 23:17:17.438125 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0317 23:17:17.438201 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:17.438236 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0317 23:17:17.438202 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:17.438326 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:17.438446 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:17.438477 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:17.438576 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0317 23:17:17.438690 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:17.438753 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:17.438888 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:17.438964 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0317 23:17:17.439085 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:17.439122 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:17.439189 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:17.439286 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I0317 23:17:17.439384 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:17.439454 32978 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0317 23:17:17.439583 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:17.439671 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:17.439774 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:17.440020 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:17.440179 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:17.440365 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:17.440476 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:17.440601 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:17.440712 32978 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0317 23:17:17.440777 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:17.440835 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:17.440850 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:17.440879 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:17.440776 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:17.440903 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0317 23:17:17.440930 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:17.440954 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:17.440978 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0317 23:17:17.441112 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I0317 23:17:17.441142 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0317 23:17:17.441163 32978 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I0317 23:17:17.441186 32978 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I0317 23:17:17.441207 32978 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0317 23:17:17.441281 32978 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0317 23:17:17.441331 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:17.441358 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W0317 23:17:17.441386 32978 api.go:53] PageSize not implemented I0317 23:17:17.441423 32978 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0317 23:17:17.441485 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:17.441473 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:17.441517 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:17.441556 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:17.441533 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:17.441581 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:17.441597 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:17.441517 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:17.441613 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:17.441683 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:17.441703 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:17.441758 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:17.441793 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:17.441804 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:17.446129 32978 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0317 23:17:17.446243 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:17.446373 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:17.446440 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:17.446560 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:17.447000 32978 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0317 23:17:17.447185 32978 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0317 23:17:17.447405 32978 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0317 23:17:17.447443 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:17.447473 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:17.447528 32978 dns.go:235] Pre-creating DNS records I0317 23:17:17.453495 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:17:17.456664 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:17.456749 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:18.735618 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:18.891456 32978 iamrole.go:89] ListRoles: { } I0317 23:17:18.892623 32978 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0317 23:17:18.892925 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0317 23:17:18.893065 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:18.893193 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:18.893228 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:18.893282 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:18.893151 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:18.893321 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0317 23:17:18.893462 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:18.894279 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:18.896025 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:18.896518 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0317 23:17:18.896854 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0317 23:17:18.897250 32978 api.go:53] PageSize not implemented I0317 23:17:18.899471 32978 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0317 23:17:18.899615 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0317 23:17:18.899702 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0317 23:17:18.899789 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:18.899827 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0317 23:17:18.899776 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:18.900463 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0317 23:17:18.900492 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:18.900532 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:18.900403 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0317 23:17:18.900563 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0317 23:17:18.900620 32978 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0317 23:17:18.900590 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:18.900702 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:18.900774 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:18.900843 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:18.900957 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:18.901067 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:18.901097 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0317 23:17:18.901207 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:18.901244 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:18.901336 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:18.901361 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0317 23:17:18.901460 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:18.901522 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:18.901665 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:18.901786 32978 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0317 23:17:18.901925 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:18.902007 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:18.902290 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:18.902445 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:18.902524 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:18.902617 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:18.902707 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:18.902870 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:18.903072 32978 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0317 23:17:18.903130 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:18.903170 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:18.903242 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:18.903258 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:18.903290 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:18.903316 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0317 23:17:18.903344 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:18.903435 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:18.903464 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0317 23:17:18.903539 32978 api.go:53] PageSize not implemented I0317 23:17:18.903587 32978 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0317 23:17:18.903654 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:18.903688 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:18.903650 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:18.903716 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:18.903715 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:18.903759 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:18.903729 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:18.903789 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:18.903812 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:18.903882 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:18.903932 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:18.903957 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:18.904030 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:18.904056 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:18.909012 32978 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0317 23:17:18.909114 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:18.909263 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:18.909389 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:18.909517 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:18.910123 32978 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0317 23:17:18.910336 32978 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0317 23:17:18.910537 32978 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I0317 23:17:18.913127 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:18.915921 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:18.925210 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:17:18.928943 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:18.929009 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:20.170685 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:20.322521 32978 iamrole.go:89] ListRoles: { } I0317 23:17:20.324247 32978 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0317 23:17:20.324483 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0317 23:17:20.324453 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:20.324674 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } W0317 23:17:20.324759 32978 api.go:53] PageSize not implemented I0317 23:17:20.324841 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0317 23:17:20.324950 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0317 23:17:20.325263 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0317 23:17:20.325334 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:20.325473 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0317 23:17:20.325543 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0317 23:17:20.325593 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:20.325652 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:20.325667 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:20.325696 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:20.327048 32978 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0317 23:17:20.327175 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0317 23:17:20.327188 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0317 23:17:20.327298 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:20.327346 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0317 23:17:20.327189 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0317 23:17:20.327360 32978 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0317 23:17:20.327405 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0317 23:17:20.327421 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0317 23:17:20.327528 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:20.327551 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:20.327556 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:20.327598 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0317 23:17:20.327632 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:20.327676 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:20.327736 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:20.327803 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:20.327822 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:20.327864 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:20.327903 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:20.327942 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0317 23:17:20.328018 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:20.328078 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:20.328217 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:20.328328 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:20.328357 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:20.328786 32978 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0317 23:17:20.328937 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:20.329027 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:20.329125 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:20.329435 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:20.329583 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:20.329707 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:20.329738 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:20.329928 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:20.330037 32978 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0317 23:17:20.330109 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0317 23:17:20.330115 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0317 23:17:20.330161 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:20.330206 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:20.330241 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:20.330267 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0317 23:17:20.330296 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:20.330320 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:20.330342 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0317 23:17:20.330410 32978 api.go:53] PageSize not implemented I0317 23:17:20.330449 32978 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0317 23:17:20.330486 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0317 23:17:20.330512 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:20.330545 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0317 23:17:20.330524 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:20.330574 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:20.330601 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:20.330654 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:20.330669 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:20.330741 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:20.330767 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:20.330851 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:20.330884 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:20.330956 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:20.330984 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:20.334984 32978 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0317 23:17:20.335079 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:20.335198 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:20.335262 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:20.335388 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:20.335761 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:20.335808 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:20.335974 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:17:20.336145 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:17:20.336374 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0317 23:17:20.336417 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:20.336448 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:20.336508 32978 dns.go:235] Pre-creating DNS records I0317 23:17:20.342715 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:17:20.346241 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:20.346314 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:21.560210 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:21.710609 32978 iamrole.go:89] ListRoles: { } I0317 23:17:21.712046 32978 executor.go:111] Tasks: 0 done / 136 total; 52 can run W0317 23:17:21.712356 32978 api.go:53] PageSize not implemented I0317 23:17:21.712340 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:21.712326 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:21.712545 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0317 23:17:21.712661 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0317 23:17:21.712749 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:21.712781 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:21.712831 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:21.712876 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0317 23:17:21.712995 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0317 23:17:21.713113 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:21.713285 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0317 23:17:21.713435 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0317 23:17:21.713678 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:21.715279 32978 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0317 23:17:21.715431 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0317 23:17:21.715508 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:21.715535 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0317 23:17:21.715577 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0317 23:17:21.715392 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:21.715652 32978 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0317 23:17:21.715634 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0317 23:17:21.715637 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0317 23:17:21.715711 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:21.715803 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:21.715826 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0317 23:17:21.715854 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:21.715966 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:21.716064 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0317 23:17:21.716171 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:21.716225 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:21.716316 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:21.716380 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:21.716492 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:21.716521 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0317 23:17:21.716632 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:21.716667 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:21.716748 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:21.716851 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:21.716878 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:21.717190 32978 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0317 23:17:21.717370 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:21.717482 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:21.717646 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:21.717898 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:21.718082 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:21.718217 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:21.718274 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:21.718377 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:21.718428 32978 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0317 23:17:21.718487 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:21.718537 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:21.718550 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:21.718580 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:21.718485 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:21.718604 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0317 23:17:21.718631 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:21.718655 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:21.718675 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0317 23:17:21.718742 32978 api.go:53] PageSize not implemented I0317 23:17:21.718777 32978 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0317 23:17:21.718828 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:21.718819 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:21.718858 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:21.718859 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:21.718885 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:21.718944 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:21.718870 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:21.719070 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:21.719095 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:21.719163 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:21.719196 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:21.719211 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:21.719295 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:21.719330 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:21.723551 32978 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0317 23:17:21.723668 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:21.723838 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:21.723997 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:21.724118 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:21.724508 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:17:21.724718 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:17:21.724859 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I0317 23:17:21.728479 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:21.731179 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:21.731237 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:21.738556 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:17:21.741776 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:21.741839 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:21.741877 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:22.974937 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:23.124143 32978 iamrole.go:89] ListRoles: { } I0317 23:17:23.125282 32978 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0317 23:17:23.125448 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:23.125511 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0317 23:17:23.125877 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0317 23:17:23.125984 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0317 23:17:23.126174 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:23.126294 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:23.126321 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:23.126356 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:23.126480 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:23.126515 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0317 23:17:23.126587 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0317 23:17:23.127882 32978 api.go:53] PageSize not implemented I0317 23:17:23.126904 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:23.129142 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0317 23:17:23.131263 32978 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0317 23:17:23.131391 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0317 23:17:23.131571 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0317 23:17:23.131600 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:23.131620 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0317 23:17:23.131695 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:23.131694 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:23.131735 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0317 23:17:23.131809 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0317 23:17:23.132273 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:23.132328 32978 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0317 23:17:23.131756 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:23.132332 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0317 23:17:23.132423 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:23.132475 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:23.132562 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:23.132674 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:23.132704 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0317 23:17:23.132820 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0317 23:17:23.132966 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:23.133003 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:23.133098 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0317 23:17:23.133200 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0317 23:17:23.133313 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:23.133345 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:23.133432 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:23.134229 32978 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0317 23:17:23.134306 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:23.134401 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:23.134466 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:23.134768 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:23.134845 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:23.134960 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:23.135266 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:23.135373 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:23.135447 32978 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0317 23:17:23.135491 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:23.135517 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:23.135573 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:23.135586 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:23.135616 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:23.135640 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0317 23:17:23.135665 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:23.135687 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:23.135707 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0317 23:17:23.135771 32978 api.go:53] PageSize not implemented I0317 23:17:23.135807 32978 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0317 23:17:23.135845 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:23.135887 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:23.135870 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:23.135919 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:23.135901 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:23.135939 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:23.135963 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:23.135980 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:23.136037 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:23.136055 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:23.136138 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:23.136173 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:23.136318 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:23.136375 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:23.140546 32978 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0317 23:17:23.140622 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:23.140742 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:23.140801 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:23.140947 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:23.141636 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:17:23.141883 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:17:23.142024 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0317 23:17:23.142059 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:23.142085 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:23.142138 32978 dns.go:235] Pre-creating DNS records I0317 23:17:23.148179 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:17:23.151391 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:23.151454 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:23.151491 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:24.396709 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:24.546474 32978 iamrole.go:89] ListRoles: { } I0317 23:17:24.548233 32978 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0317 23:17:24.548501 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:24.548671 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0317 23:17:24.548828 32978 api.go:53] PageSize not implemented I0317 23:17:24.548827 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:24.548893 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0317 23:17:24.548987 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0317 23:17:24.549143 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:24.549312 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0317 23:17:24.549395 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0317 23:17:24.549467 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:24.549544 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:24.549566 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:24.549611 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:24.549641 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0317 23:17:24.551562 32978 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0317 23:17:24.551690 32978 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0317 23:17:24.551690 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:24.551686 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0317 23:17:24.551791 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:24.551836 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0317 23:17:24.551885 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0317 23:17:24.551787 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0317 23:17:24.552291 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0317 23:17:24.552372 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:24.552411 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0317 23:17:24.552414 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:24.552489 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:24.552625 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:24.552717 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:24.552802 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:24.552924 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:24.553048 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:24.553093 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0317 23:17:24.553231 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:24.553278 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0317 23:17:24.553375 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0317 23:17:24.553511 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:24.553562 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0317 23:17:24.553689 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:24.553727 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:24.553829 32978 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0317 23:17:24.554008 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:24.554094 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:24.554239 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:24.554267 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:24.554607 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:24.554736 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:24.554900 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:24.554960 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:24.555034 32978 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0317 23:17:24.555083 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:24.555095 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:24.555153 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:24.555167 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:24.555197 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:24.555222 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0317 23:17:24.555249 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:24.555271 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:24.555294 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0317 23:17:24.555363 32978 api.go:53] PageSize not implemented I0317 23:17:24.555400 32978 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0317 23:17:24.555451 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:24.555445 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:24.555483 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:24.555485 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:24.555496 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:24.555542 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:24.555598 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:24.555621 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:24.555653 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:24.555730 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:24.555771 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:24.555858 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:24.555914 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:24.555928 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:24.560362 32978 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0317 23:17:24.560527 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:24.560659 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:24.560708 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:24.560838 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:24.561429 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:17:24.561632 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:17:24.561806 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I0317 23:17:24.563990 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:24.566682 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:24.566766 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:24.566815 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:24.574284 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:17:24.577496 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:24.577567 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:24.577605 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:24.577640 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:25.854426 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:26.005554 32978 iamrole.go:89] ListRoles: { } I0317 23:17:26.007007 32978 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0317 23:17:26.007208 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0317 23:17:26.007335 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:26.007471 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:26.007513 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:26.007601 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0317 23:17:26.007744 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:26.007889 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } W0317 23:17:26.007929 32978 api.go:53] PageSize not implemented I0317 23:17:26.008048 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:26.008192 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:26.008519 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0317 23:17:26.008647 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0317 23:17:26.008754 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0317 23:17:26.008914 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0317 23:17:26.010192 32978 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0317 23:17:26.010379 32978 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0317 23:17:26.010354 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0317 23:17:26.010417 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0317 23:17:26.010310 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:26.010440 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:26.010485 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0317 23:17:26.010474 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0317 23:17:26.010607 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:26.010550 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0317 23:17:26.010662 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:26.010697 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0317 23:17:26.010657 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:26.010817 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:26.010851 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:26.010923 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:26.011020 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:26.011108 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0317 23:17:26.011209 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:26.011247 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:26.011343 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:26.011369 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:26.011429 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0317 23:17:26.011515 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0317 23:17:26.011625 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:26.011672 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:26.011796 32978 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0317 23:17:26.011951 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:26.012130 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:26.012208 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:26.012339 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:26.012387 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:26.012435 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:26.012577 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:26.012665 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:26.012813 32978 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0317 23:17:26.012851 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:26.012884 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:26.012971 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:26.012987 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:26.013017 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:26.013046 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0317 23:17:26.013076 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:26.013100 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:26.013125 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0317 23:17:26.013202 32978 api.go:53] PageSize not implemented I0317 23:17:26.013252 32978 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0317 23:17:26.013313 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:26.013350 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:26.013411 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:26.013453 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:26.013364 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:26.013476 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:26.013489 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:26.013592 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:26.013631 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:26.013717 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:26.013780 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:26.013803 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:26.013899 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:26.013939 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:26.017851 32978 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0317 23:17:26.017957 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:26.018077 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:26.018206 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:26.018242 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:26.018878 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:17:26.019133 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:17:26.019350 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0317 23:17:26.019394 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:26.019427 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:26.019486 32978 dns.go:235] Pre-creating DNS records I0317 23:17:26.025761 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0317 23:17:26.029222 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:26.029294 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:26.029335 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:26.029368 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:27.292103 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:27.447310 32978 iamrole.go:89] ListRoles: { } I0317 23:17:27.448741 32978 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0317 23:17:27.449030 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.449126 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:27.449165 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0317 23:17:27.449281 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0317 23:17:27.449418 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.449570 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0317 23:17:27.449644 32978 api.go:53] PageSize not implemented I0317 23:17:27.449655 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:27.449681 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:27.449728 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:27.449759 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0317 23:17:27.449837 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.449943 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0317 23:17:27.450019 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0317 23:17:27.451386 32978 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0317 23:17:27.451520 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0317 23:17:27.451597 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:27.451631 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0317 23:17:27.451544 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.451750 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0317 23:17:27.451716 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0317 23:17:27.451804 32978 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0317 23:17:27.451741 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0317 23:17:27.451836 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:27.451881 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:27.451925 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0317 23:17:27.451946 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0317 23:17:27.452089 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:27.452134 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0317 23:17:27.452305 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:27.452353 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.452468 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0317 23:17:27.452581 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:27.452633 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:27.452725 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:27.452792 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:27.452853 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.452968 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:27.452997 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.453090 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:27.453176 32978 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0317 23:17:27.453309 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:27.453435 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.453565 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:27.453640 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0317 23:17:27.453672 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:27.453870 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:27.453966 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:27.454087 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:27.454295 32978 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0317 23:17:27.454349 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:27.454400 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:27.454414 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:27.454378 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:27.454443 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:27.454470 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0317 23:17:27.454497 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0317 23:17:27.454519 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0317 23:17:27.454541 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0317 23:17:27.454610 32978 api.go:53] PageSize not implemented I0317 23:17:27.454646 32978 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0317 23:17:27.454700 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:27.454733 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:27.454706 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:27.454755 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:27.454752 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:27.454775 32978 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0317 23:17:27.454770 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:27.454880 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:27.454943 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:27.454959 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:27.455028 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:27.455055 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:27.455132 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0317 23:17:27.455163 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:27.459139 32978 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0317 23:17:27.459235 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:27.459365 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:27.459422 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:27.459568 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:27.459989 32978 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0317 23:17:27.460185 32978 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0317 23:17:27.460401 32978 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0317 23:17:27.460530 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0317 23:17:27.460573 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:17:27.460604 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0317 23:17:27.460627 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:27.460651 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0317 23:17:27.460673 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0317 23:17:27.460696 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:27.460719 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0317 23:17:27.460749 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0317 23:17:27.460797 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:17:27.460820 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:17:27.460842 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:27.460868 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0317 23:17:27.460890 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0317 23:17:27.460915 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:27.460939 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:27.460964 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:27.460988 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:27.461013 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:27.461036 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:27.461062 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0317 23:17:27.461087 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:17:27.461108 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0317 23:17:27.461129 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:27.461153 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:27.461178 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:27.461204 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0317 23:17:27.463205 32978 delete_cluster.go:128] Looking for cloud resources to delete W0317 23:17:27.463252 32978 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0317 23:17:27.463268 32978 keypairs.go:95] DescribeKeyPairs: { } I0317 23:17:27.463295 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.463336 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0317 23:17:27.463381 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.463444 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.463477 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.463518 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.463547 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.463580 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0317 23:17:27.463619 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.463667 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0317 23:17:27.463695 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W0317 23:17:27.463735 32978 api.go:53] PageSize not implemented I0317 23:17:27.463750 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:27.463769 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:27.463780 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0317 23:17:27.463807 32978 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0317 23:17:27.463824 32978 targetgroups.go:35] PageSize not implemented I0317 23:17:27.463836 32978 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" ] } I0317 23:17:27.463888 32978 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0317 23:17:27.463916 32978 iamrole.go:89] ListRoles: { } I0317 23:17:27.463950 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:27.463970 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:27.463999 32978 internetgateways.go:101] DescribeInternetGateways: { } I0317 23:17:27.464032 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:27.464065 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0317 23:17:27.464477 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0317 23:17:27.464539 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0317 23:17:27.464527 32978 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok I0317 23:17:27.464584 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok autoscaling-group:nodes.complex.example.com ok I0317 23:17:27.464583 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0317 23:17:27.464649 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0317 23:17:27.464635 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } I0317 23:17:27.464650 32978 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } autoscaling-group:master-us-test-1a.masters.complex.example.com ok volume:vol-2 ok I0317 23:17:27.464697 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0317 23:17:27.464701 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5 ok I0317 23:17:27.464736 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0317 23:17:27.464724 32978 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } iam-instance-profile:masters.complex.example.com ok iam-instance-profile:nodes.complex.example.com ok I0317 23:17:27.464638 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.complex.example.com. ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4 ok I0317 23:17:27.464752 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0317 23:17:27.464918 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:27.464939 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0317 23:17:27.464966 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:27.465019 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0317 23:17:27.465272 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:27.465291 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0317 23:17:27.465324 32978 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0317 23:17:27.465366 32978 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0317 23:17:27.465390 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:27.465423 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-1 ok I0317 23:17:27.465481 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0317 23:17:27.465508 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I0317 23:17:27.465527 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0317 23:17:27.465551 32978 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I0317 23:17:27.465567 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0317 23:17:27.465593 32978 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I0317 23:17:27.465628 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I0317 23:17:27.465691 32978 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I0317 23:17:27.465704 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0317 23:17:27.465729 32978 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I0317 23:17:27.465793 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0317 23:17:27.465856 32978 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0317 23:17:27.465914 32978 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (14.33s) === RUN TestLifecycleExternalLB I0317 23:17:27.466376 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:17:27.466589 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:17:27.466619 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:17:27.466651 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:17:27.466680 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:17:27.466714 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:17:27.466769 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:17:27.466790 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:17:27.466820 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:17:27.466840 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I0317 23:17:27.485483 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:27.487953 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:27.488084 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:28.715389 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:28.854680 32978 iamrole.go:89] ListRoles: { } I0317 23:17:28.855726 32978 executor.go:111] Tasks: 0 done / 107 total; 51 can run W0317 23:17:28.856122 32978 api.go:53] PageSize not implemented I0317 23:17:28.856166 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I0317 23:17:28.856140 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:28.856308 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0317 23:17:28.856339 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } W0317 23:17:28.856474 32978 api.go:53] PageSize not implemented I0317 23:17:28.856431 32978 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0317 23:17:28.856433 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:28.856459 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0317 23:17:28.856533 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:17:28.856548 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0317 23:17:28.856563 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I0317 23:17:28.856593 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:28.856657 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0317 23:17:28.856757 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } W0317 23:17:28.856861 32978 api.go:53] PageSize not implemented I0317 23:17:28.856863 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0317 23:17:28.856895 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0317 23:17:28.856774 32978 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0317 23:17:28.856962 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0317 23:17:28.857006 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0317 23:17:28.857031 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:28.857069 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:28.857195 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:28.857320 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:28.857420 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:28.857378 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0317 23:17:28.857495 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0317 23:17:28.857536 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0317 23:17:28.857460 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:28.857583 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:28.857679 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:28.857714 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:28.857829 32978 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0317 23:17:28.858696 32978 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0317 23:17:28.858828 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0317 23:17:28.858801 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0317 23:17:28.858902 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:28.858958 32978 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0317 23:17:28.859049 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0317 23:17:28.859082 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0317 23:17:28.859045 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I0317 23:17:28.859165 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0317 23:17:28.859253 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "masters.externallb.example.com" }] }], VpcId: "vpc-1" } I0317 23:17:28.859285 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0317 23:17:28.859353 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:28.859406 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:28.859445 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:28.859482 32978 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0317 23:17:28.859477 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0317 23:17:28.859543 32978 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0317 23:17:28.859578 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:28.859726 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0317 23:17:28.859741 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:28.859885 32978 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0317 23:17:28.859949 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:28.859984 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:28.860086 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0317 23:17:28.860254 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.externallb.example.com" }] }], VpcId: "vpc-1" } I0317 23:17:28.860324 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:28.860360 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:28.860419 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:28.860481 32978 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0317 23:17:28.860528 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:28.860548 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0317 23:17:28.863119 32978 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0317 23:17:28.863268 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:28.863354 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:28.863560 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0317 23:17:28.863639 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:28.863802 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0317 23:17:28.864028 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0317 23:17:28.864275 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0317 23:17:28.864472 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0317 23:17:28.864627 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0317 23:17:28.864794 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0317 23:17:28.864920 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:28.865010 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:28.865119 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" }] }] } I0317 23:17:28.865284 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0317 23:17:28.865396 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0317 23:17:28.865496 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0317 23:17:28.865596 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0317 23:17:28.865691 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0317 23:17:28.865793 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0317 23:17:28.865888 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0317 23:17:28.865925 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0317 23:17:28.865954 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0317 23:17:28.866078 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0317 23:17:28.866117 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:28.866194 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:28.866722 32978 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0317 23:17:28.866985 32978 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0317 23:17:28.867197 32978 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0317 23:17:28.867237 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:28.867270 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:28.867326 32978 dns.go:235] Pre-creating DNS records I0317 23:17:28.867351 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:28.872034 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:28.874636 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:28.874706 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:30.099559 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:30.235257 32978 iamrole.go:89] ListRoles: { } I0317 23:17:30.236326 32978 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0317 23:17:30.236555 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0317 23:17:30.236630 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0317 23:17:30.236657 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } W0317 23:17:30.236719 32978 api.go:53] PageSize not implemented W0317 23:17:30.236834 32978 api.go:53] PageSize not implemented I0317 23:17:30.236818 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0317 23:17:30.236930 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0317 23:17:30.236904 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.236970 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0317 23:17:30.237025 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } W0317 23:17:30.236905 32978 api.go:53] PageSize not implemented I0317 23:17:30.237182 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.237309 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.237396 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:30.237520 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.237549 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0317 23:17:30.237612 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:30.237634 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:30.237634 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0317 23:17:30.237661 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0317 23:17:30.237675 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:30.239021 32978 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0317 23:17:30.239254 32978 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0317 23:17:30.239177 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.239369 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:30.239418 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:30.239471 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0317 23:17:30.239489 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I0317 23:17:30.239587 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:30.239648 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0317 23:17:30.239790 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:30.239834 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.239965 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0317 23:17:30.240090 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:30.243304 32978 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0317 23:17:30.243473 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:30.243572 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:30.243716 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:30.243837 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:30.244007 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:30.244131 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:30.244273 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:30.244653 32978 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0317 23:17:30.244818 32978 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0317 23:17:30.245015 32978 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0317 23:17:30.247291 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0317 23:17:30.247341 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:17:30.247369 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0317 23:17:30.247393 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:30.247416 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0317 23:17:30.247439 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0317 23:17:30.247461 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:30.247485 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0317 23:17:30.247510 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0317 23:17:30.247539 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0317 23:17:30.247566 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:17:30.247592 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:17:30.247614 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:30.247637 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0317 23:17:30.247659 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:30.247681 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:30.247705 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:30.247728 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:30.247749 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:17:30.247770 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0317 23:17:30.247791 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:30.247814 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:30.247840 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:30.247863 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0317 23:17:30.248864 32978 delete_cluster.go:128] Looking for cloud resources to delete W0317 23:17:30.248915 32978 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0317 23:17:30.248930 32978 keypairs.go:95] DescribeKeyPairs: { } I0317 23:17:30.248959 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.248999 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0317 23:17:30.249038 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.249080 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.249111 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.249148 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.249180 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.249207 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0317 23:17:30.249241 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.249279 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0317 23:17:30.249305 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W0317 23:17:30.249344 32978 api.go:53] PageSize not implemented I0317 23:17:30.249361 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:30.249381 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:30.249395 32978 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0317 23:17:30.249413 32978 targetgroups.go:35] PageSize not implemented I0317 23:17:30.249426 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0317 23:17:30.249465 32978 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0317 23:17:30.249492 32978 iamrole.go:89] ListRoles: { } I0317 23:17:30.249529 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:30.249551 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:30.249583 32978 internetgateways.go:101] DescribeInternetGateways: { } I0317 23:17:30.249618 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:30.249644 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:nodes.externallb.example.com ok I0317 23:17:30.249990 32978 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0317 23:17:30.250034 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I0317 23:17:30.250051 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } I0317 23:17:30.250127 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok I0317 23:17:30.250139 32978 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0317 23:17:30.250162 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0317 23:17:30.250169 32978 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0317 23:17:30.250203 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok autoscaling-config:lt-2 ok volume:vol-2 ok I0317 23:17:30.250243 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0317 23:17:30.250178 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.externallb.example.com. ok I0317 23:17:30.250326 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:30.250375 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W0317 23:17:30.250530 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:30.250550 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I0317 23:17:30.250584 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:30.250619 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0317 23:17:30.250703 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:30.250714 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0317 23:17:30.250781 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I0317 23:17:30.250823 32978 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I0317 23:17:30.250796 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0317 23:17:30.250838 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I0317 23:17:30.250886 32978 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I0317 23:17:30.250898 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0317 23:17:30.250923 32978 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I0317 23:17:30.250945 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0317 23:17:30.250965 32978 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I0317 23:17:30.251019 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0317 23:17:30.251081 32978 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0317 23:17:30.251137 32978 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (2.79s) === RUN TestLifecycleSharedSubnet I0317 23:17:30.251591 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:17:30.251815 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:17:30.251847 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:17:30.251880 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:17:30.251908 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:17:30.251944 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:17:30.251976 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:17:30.251999 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:17:30.252028 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:17:30.252050 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I0317 23:17:30.270541 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:30.273003 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:30.273139 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:31.522031 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:31.661962 32978 iamrole.go:89] ListRoles: { } I0317 23:17:31.662838 32978 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0317 23:17:31.663054 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0317 23:17:31.663124 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0317 23:17:31.663250 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:17:31.663360 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0317 23:17:31.663299 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:31.663388 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0317 23:17:31.663446 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0317 23:17:31.663552 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] } I0317 23:17:31.663813 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0317 23:17:31.663982 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:31.664148 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:31.664202 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0317 23:17:31.664374 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:31.664493 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:31.664538 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:31.664675 32978 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.665924 32978 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0317 23:17:31.666057 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0317 23:17:31.666126 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0317 23:17:31.666214 32978 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0317 23:17:31.666261 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0317 23:17:31.666179 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0317 23:17:31.666314 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0317 23:17:31.666381 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:17:31.666481 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0317 23:17:31.666490 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0317 23:17:31.666629 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0317 23:17:31.666700 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:31.666760 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:31.666812 32978 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" } ] } I0317 23:17:31.666874 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0317 23:17:31.666945 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:31.666980 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:31.667009 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:31.667732 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0317 23:17:31.670262 32978 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0317 23:17:31.670429 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.670579 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.670757 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.670865 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:31.670938 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:31.671087 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0317 23:17:31.671301 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.671416 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" }] }] } I0317 23:17:31.671576 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.671766 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.671913 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.672020 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.672120 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.672213 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.672304 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0317 23:17:31.672399 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:31.672469 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:31.672554 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0317 23:17:31.672787 32978 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0317 23:17:31.672994 32978 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0317 23:17:31.673161 32978 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0317 23:17:31.673195 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:31.673226 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:31.673280 32978 dns.go:235] Pre-creating DNS records I0317 23:17:31.673304 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:31.678117 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:31.680630 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:31.680699 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:32.963171 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:33.103107 32978 iamrole.go:89] ListRoles: { } I0317 23:17:33.103976 32978 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0317 23:17:33.104788 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:33.105027 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:33.105146 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0317 23:17:33.105330 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:17:33.105391 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0317 23:17:33.105415 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0317 23:17:33.105654 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] }] } I0317 23:17:33.107044 32978 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0317 23:17:33.107128 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0317 23:17:33.107204 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0317 23:17:33.107344 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:17:33.107399 32978 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0317 23:17:33.107431 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0317 23:17:33.107544 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:33.107581 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0317 23:17:33.107684 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:33.111535 32978 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0317 23:17:33.111700 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:33.111824 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:33.111949 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:33.112090 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:33.112414 32978 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0317 23:17:33.112589 32978 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0317 23:17:33.112805 32978 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0317 23:17:33.114836 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0317 23:17:33.114893 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0317 23:17:33.114919 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:33.114945 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0317 23:17:33.114964 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0317 23:17:33.114984 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0317 23:17:33.115015 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0317 23:17:33.115045 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0317 23:17:33.115073 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:17:33.115095 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:17:33.115115 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0317 23:17:33.115136 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:33.115158 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:33.115181 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:33.115205 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:17:33.115228 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0317 23:17:33.115251 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:33.115275 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:33.115300 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0317 23:17:33.116349 32978 delete_cluster.go:128] Looking for cloud resources to delete W0317 23:17:33.116403 32978 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0317 23:17:33.116419 32978 keypairs.go:95] DescribeKeyPairs: { } I0317 23:17:33.116452 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0317 23:17:33.116492 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0317 23:17:33.116533 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0317 23:17:33.116577 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0317 23:17:33.116606 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0317 23:17:33.116637 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0317 23:17:33.116671 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0317 23:17:33.116697 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0317 23:17:33.116726 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0317 23:17:33.116786 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0317 23:17:33.116814 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W0317 23:17:33.116851 32978 api.go:53] PageSize not implemented I0317 23:17:33.116869 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:33.116891 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:33.116908 32978 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0317 23:17:33.116927 32978 targetgroups.go:35] PageSize not implemented I0317 23:17:33.116941 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0317 23:17:33.116980 32978 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0317 23:17:33.117014 32978 iamrole.go:89] ListRoles: { } I0317 23:17:33.117051 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:33.117076 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:33.117112 32978 internetgateways.go:101] DescribeInternetGateways: { } I0317 23:17:33.117145 32978 routetable.go:53] DescribeRouteTables: { } autoscaling-group:nodes.sharedsubnet.example.com ok I0317 23:17:33.117441 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0317 23:17:33.117510 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok I0317 23:17:33.117540 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0317 23:17:33.117603 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } iam-instance-profile:nodes.sharedsubnet.example.com ok I0317 23:17:33.117518 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:33.117634 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.sharedsubnet.example.com. ok I0317 23:17:33.117670 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok I0317 23:17:33.117552 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0317 23:17:33.117717 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:33.117733 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0317 23:17:33.117765 32978 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0317 23:17:33.117848 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I0317 23:17:33.117912 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:33.117974 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0317 23:17:33.118072 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:33.118091 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0317 23:17:33.118153 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I0317 23:17:33.118188 32978 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0317 23:17:33.118200 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0317 23:17:33.118225 32978 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok I0317 23:17:33.118254 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I0317 23:17:33.118292 32978 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0317 23:17:33.118303 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0317 23:17:33.118330 32978 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (2.87s) === RUN TestLifecyclePrivateSharedSubnet I0317 23:17:33.118814 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:17:33.119029 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:17:33.119058 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:17:33.119100 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:17:33.119129 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:17:33.119164 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:17:33.119196 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:17:33.119216 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:17:33.119244 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:17:33.119264 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I0317 23:17:33.140223 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:33.142845 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:33.142971 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:33.143010 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:34.357865 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:34.493815 32978 iamrole.go:89] ListRoles: { } I0317 23:17:34.494786 32978 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0317 23:17:34.495091 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:34.495165 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:17:34.495296 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0317 23:17:34.495307 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0317 23:17:34.496687 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0317 23:17:34.496789 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0317 23:17:34.496850 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:34.496981 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:34.497128 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0317 23:17:34.497167 32978 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0317 23:17:34.497218 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0317 23:17:34.497286 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0317 23:17:34.497347 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0317 23:17:34.497354 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:34.497506 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:34.497561 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:34.498062 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:34.498193 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:34.502152 32978 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0317 23:17:34.502274 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0317 23:17:34.502403 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0317 23:17:34.502469 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0317 23:17:34.502366 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0317 23:17:34.502432 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0317 23:17:34.502511 32978 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0317 23:17:34.502593 32978 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0317 23:17:34.502585 32978 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0317 23:17:34.502683 32978 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0317 23:17:34.502580 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:17:34.502762 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0317 23:17:34.502883 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0317 23:17:34.502913 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0317 23:17:34.502934 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0317 23:17:34.502986 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:34.503023 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:34.503013 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0317 23:17:34.503110 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0317 23:17:34.503067 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0317 23:17:34.503170 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:34.503221 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:34.503264 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0317 23:17:34.503417 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0317 23:17:34.503574 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0317 23:17:34.503663 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:34.503700 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:34.503739 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0317 23:17:34.503904 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0317 23:17:34.503978 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0317 23:17:34.504018 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0317 23:17:34.504055 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:17:34.504087 32978 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/role/elb", Value: "1" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" }] } I0317 23:17:34.504151 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:34.504218 32978 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" }] } I0317 23:17:34.504738 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0317 23:17:34.505072 32978 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0317 23:17:34.505214 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } W0317 23:17:34.505368 32978 api.go:53] PageSize not implemented I0317 23:17:34.505396 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:34.505493 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:34.505491 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:34.505457 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" }] }] } I0317 23:17:34.505576 32978 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-subnet.example.com" }] } I0317 23:17:34.505626 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:34.505609 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0317 23:17:34.505651 32978 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0317 23:17:34.505611 32978 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I0317 23:17:34.505702 32978 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0317 23:17:34.505696 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0317 23:17:34.505857 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0317 23:17:34.505987 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0317 23:17:34.506142 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" }] }] } I0317 23:17:34.506295 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I0317 23:17:34.506419 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0317 23:17:34.506528 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" }] }] } I0317 23:17:34.506672 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I0317 23:17:34.506875 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" }] }] } I0317 23:17:34.507083 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0317 23:17:34.507241 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" }] }] } I0317 23:17:34.507425 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0317 23:17:34.507460 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0317 23:17:34.507507 32978 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } W0317 23:17:34.507589 32978 api.go:53] PageSize not implemented I0317 23:17:34.507542 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0317 23:17:34.507607 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:34.507638 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0317 23:17:34.507733 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0317 23:17:34.507825 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0317 23:17:34.507927 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0317 23:17:34.508020 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0317 23:17:34.508109 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" }] }] } I0317 23:17:34.508220 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I0317 23:17:34.508321 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:34.508399 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:34.508468 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0317 23:17:34.508614 32978 executor.go:111] Tasks: 103 done / 123 total; 5 can run I0317 23:17:34.508677 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0317 23:17:34.508691 32978 api.go:53] PageSize not implemented I0317 23:17:34.508738 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:34.508760 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } W0317 23:17:34.508855 32978 api.go:53] PageSize not implemented I0317 23:17:34.508861 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:34.508902 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:34.508924 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:34.513161 32978 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0317 23:17:34.513340 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:34.513473 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:34.513547 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:34.513652 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:34.514090 32978 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0317 23:17:34.514295 32978 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0317 23:17:34.514472 32978 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0317 23:17:34.514507 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:34.514536 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:34.514591 32978 dns.go:235] Pre-creating DNS records I0317 23:17:34.514612 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:34.519509 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:34.522332 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:34.522396 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:34.522443 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:35.747405 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:35.970092 32978 iamrole.go:89] ListRoles: { } I0317 23:17:35.971374 32978 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0317 23:17:35.971560 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:35.971743 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:35.971952 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:35.972450 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:17:35.972520 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0317 23:17:35.972547 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0317 23:17:35.972606 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:35.973951 32978 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0317 23:17:35.974133 32978 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0317 23:17:35.974175 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0317 23:17:35.974168 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0317 23:17:35.974240 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0317 23:17:35.974305 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0317 23:17:35.974332 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0317 23:17:35.974303 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:17:35.974384 32978 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0317 23:17:35.974417 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0317 23:17:35.974472 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0317 23:17:35.974596 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:35.974639 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0317 23:17:35.974759 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0317 23:17:35.974864 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0317 23:17:35.974986 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:35.975038 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0317 23:17:35.975194 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:35.975644 32978 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0317 23:17:35.975805 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:35.975876 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:35.975892 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } W0317 23:17:35.975928 32978 api.go:53] PageSize not implemented I0317 23:17:35.975952 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:35.976038 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:35.975926 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0317 23:17:35.976069 32978 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0317 23:17:35.976094 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0317 23:17:35.976082 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:35.976144 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0317 23:17:35.976177 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0317 23:17:35.976173 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0317 23:17:35.976245 32978 api.go:53] PageSize not implemented I0317 23:17:35.976262 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:35.976328 32978 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0317 23:17:35.976402 32978 api.go:53] PageSize not implemented I0317 23:17:35.976407 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0317 23:17:35.976428 32978 api.go:53] PageSize not implemented I0317 23:17:35.976453 32978 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0317 23:17:35.976471 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:35.976480 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:35.976491 32978 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0317 23:17:35.976529 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:35.976605 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:35.976702 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:35.980798 32978 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0317 23:17:35.980901 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:35.981020 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:35.981094 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:35.981225 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:35.981586 32978 executor.go:111] Tasks: 115 done / 123 total; 2 can run W0317 23:17:35.981660 32978 api.go:53] PageSize not implemented I0317 23:17:35.981675 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:35.981817 32978 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0317 23:17:35.982017 32978 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0317 23:17:35.984559 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0317 23:17:35.984610 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0317 23:17:35.984635 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:35.984656 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0317 23:17:35.984677 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0317 23:17:35.984697 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0317 23:17:35.984721 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0317 23:17:35.984747 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0317 23:17:35.984780 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0317 23:17:35.984806 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:17:35.984828 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:17:35.984848 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0317 23:17:35.984869 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:35.984891 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:35.984914 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:35.984938 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0317 23:17:35.984963 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:35.984987 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:17:35.985011 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0317 23:17:35.985034 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:35.985059 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:35.985086 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0317 23:17:35.986235 32978 delete_cluster.go:128] Looking for cloud resources to delete W0317 23:17:35.986291 32978 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0317 23:17:35.986306 32978 keypairs.go:95] DescribeKeyPairs: { } I0317 23:17:35.986339 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:35.986381 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0317 23:17:35.986429 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:35.986475 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:35.986504 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:35.986534 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:35.986565 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:35.986590 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0317 23:17:35.986616 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:35.986649 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0317 23:17:35.986673 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W0317 23:17:35.986706 32978 api.go:53] PageSize not implemented I0317 23:17:35.986721 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0317 23:17:35.986779 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:35.986801 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:35.986814 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0317 23:17:35.986848 32978 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0317 23:17:35.986867 32978 targetgroups.go:35] PageSize not implemented I0317 23:17:35.986880 32978 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0317 23:17:35.986924 32978 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0317 23:17:35.986957 32978 iamrole.go:89] ListRoles: { } I0317 23:17:35.986994 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:35.987016 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:35.987046 32978 internetgateways.go:101] DescribeInternetGateways: { } I0317 23:17:35.987078 32978 routetable.go:53] DescribeRouteTables: { } autoscaling-group:bastion.private-shared-subnet.example.com ok I0317 23:17:35.987472 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } I0317 23:17:35.987533 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok autoscaling-group:nodes.private-shared-subnet.example.com ok I0317 23:17:35.987577 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0317 23:17:35.987674 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:35.987639 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0317 23:17:35.987689 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } I0317 23:17:35.987708 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } volume:vol-2 ok I0317 23:17:35.987681 32978 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0317 23:17:35.987557 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.private-shared-subnet.example.com ok I0317 23:17:35.987719 32978 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0317 23:17:35.987748 32978 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0317 23:17:35.987760 32978 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } autoscaling-config:lt-1 ok I0317 23:17:35.987739 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } load-balancer:api-private-shared-subnet-n2f8ak ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I0317 23:17:35.987810 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } security-group:sg-1 ok I0317 23:17:35.987807 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } iam-instance-profile:bastions.private-shared-subnet.example.com ok I0317 23:17:35.987838 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok I0317 23:17:35.987877 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } autoscaling-config:lt-3 ok iam-instance-profile:nodes.private-shared-subnet.example.com ok iam-instance-profile:masters.private-shared-subnet.example.com ok I0317 23:17:35.987864 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0317 23:17:35.988019 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:35.988037 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0317 23:17:35.988061 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:35.988096 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W0317 23:17:35.988195 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:35.988211 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0317 23:17:35.988240 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok I0317 23:17:35.988343 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I0317 23:17:35.988381 32978 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0317 23:17:35.988364 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0317 23:17:35.988393 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0317 23:17:35.988419 32978 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok I0317 23:17:35.988401 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I0317 23:17:35.988443 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } W0317 23:17:35.988470 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:35.988477 32978 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0317 23:17:35.988482 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0317 23:17:35.988488 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0317 23:17:35.988508 32978 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok I0317 23:17:35.988532 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I0317 23:17:35.988562 32978 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0317 23:17:35.988573 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0317 23:17:35.988592 32978 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (2.87s) === RUN TestLifecyclePrivateSharedIP I0317 23:17:35.989046 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:17:35.989275 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:17:35.989310 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:17:35.989346 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:17:35.989375 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:17:35.989413 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:17:35.989448 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:17:35.989469 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:17:35.989497 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:17:35.989518 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I0317 23:17:36.013945 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:36.016552 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:36.016613 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:36.016649 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:37.245465 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:37.387234 32978 iamrole.go:89] ListRoles: { } I0317 23:17:37.388450 32978 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0317 23:17:37.388747 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:17:37.388847 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0317 23:17:37.388878 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0317 23:17:37.388983 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0317 23:17:37.389054 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0317 23:17:37.389012 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] }] } I0317 23:17:37.389184 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I0317 23:17:37.389189 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:37.389303 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:37.389282 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0317 23:17:37.389549 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:37.389509 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:37.389636 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:37.389781 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:37.389890 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:37.389934 32978 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0317 23:17:37.390146 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0317 23:17:37.390215 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0317 23:17:37.390948 32978 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0317 23:17:37.391034 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0317 23:17:37.391137 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0317 23:17:37.391210 32978 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0317 23:17:37.391160 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:37.391255 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0317 23:17:37.391303 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0317 23:17:37.391360 32978 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0317 23:17:37.391306 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0317 23:17:37.391293 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0317 23:17:37.391350 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-12345678" } I0317 23:17:37.391402 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:37.391508 32978 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0317 23:17:37.391559 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0317 23:17:37.391565 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:17:37.391563 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0317 23:17:37.391624 32978 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0317 23:17:37.391689 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0317 23:17:37.391677 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0317 23:17:37.392928 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:37.393280 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0317 23:17:37.393423 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I0317 23:17:37.393456 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:37.393670 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0317 23:17:37.393815 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0317 23:17:37.393906 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0317 23:17:37.393972 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0317 23:17:37.394217 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0317 23:17:37.394316 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0317 23:17:37.394553 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0317 23:17:37.394762 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0317 23:17:37.394905 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0317 23:17:37.395056 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:37.395157 32978 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0317 23:17:37.395329 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:37.395640 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0317 23:17:37.396013 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0317 23:17:37.396093 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0317 23:17:37.396142 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:37.396197 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:37.396241 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:37.396291 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:37.396332 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:37.396374 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:37.396409 32978 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0317 23:17:37.396504 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:37.396551 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:37.396604 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:37.397385 32978 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0317 23:17:37.397526 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:37.397648 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } W0317 23:17:37.397692 32978 api.go:53] PageSize not implemented I0317 23:17:37.397701 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:37.397716 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:37.397800 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:37.397785 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:37.397837 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0317 23:17:37.397882 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0317 23:17:37.397858 32978 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-ip.example.com" }] } I0317 23:17:37.397882 32978 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I0317 23:17:37.397949 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:37.397977 32978 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0317 23:17:37.397920 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.398018 32978 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0317 23:17:37.398077 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:37.398173 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I0317 23:17:37.398260 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.398380 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.398530 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.398629 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0317 23:17:37.398719 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:37.398811 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0317 23:17:37.398841 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0317 23:17:37.398869 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.398975 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0317 23:17:37.399053 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.399160 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.399259 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" }] }] } I0317 23:17:37.399354 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0317 23:17:37.399441 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:37.399476 32978 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0317 23:17:37.399507 32978 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } W0317 23:17:37.399602 32978 api.go:53] PageSize not implemented I0317 23:17:37.399542 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.399629 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:37.399638 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.399791 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0317 23:17:37.399901 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.400010 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.400134 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0317 23:17:37.400245 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0317 23:17:37.400323 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" }] }] } I0317 23:17:37.400418 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0317 23:17:37.400489 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0317 23:17:37.400564 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:37.400650 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:37.400729 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" }] }] } I0317 23:17:37.400858 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" }] }] } I0317 23:17:37.400985 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:37.401096 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:37.401133 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" }] }] } I0317 23:17:37.401258 32978 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I0317 23:17:37.401330 32978 executor.go:111] Tasks: 110 done / 132 total; 6 can run I0317 23:17:37.401403 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0317 23:17:37.401411 32978 api.go:53] PageSize not implemented I0317 23:17:37.401482 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:37.401463 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0317 23:17:37.401530 32978 api.go:53] PageSize not implemented I0317 23:17:37.401533 32978 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:37.401493 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:37.401576 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:37.401612 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:37.401626 32978 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0317 23:17:37.401694 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0317 23:17:37.401724 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:37.401682 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:37.401752 32978 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0317 23:17:37.405925 32978 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0317 23:17:37.406079 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:37.406194 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0317 23:17:37.406239 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:37.406318 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:37.406413 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:37.406583 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:37.407350 32978 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0317 23:17:37.407557 32978 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0317 23:17:37.407722 32978 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0317 23:17:37.407756 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:37.407787 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:37.407845 32978 dns.go:235] Pre-creating DNS records I0317 23:17:37.407867 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:37.413043 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:37.415802 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:37.415868 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:37.415908 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:38.639022 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:38.776874 32978 iamrole.go:89] ListRoles: { } I0317 23:17:38.778011 32978 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0317 23:17:38.778534 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.778697 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:38.779322 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:38.779458 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.781495 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0317 23:17:38.781620 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0317 23:17:38.781656 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0317 23:17:38.783966 32978 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0317 23:17:38.784923 32978 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0317 23:17:38.784208 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0317 23:17:38.785018 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0317 23:17:38.784970 32978 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0317 23:17:38.785048 32978 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0317 23:17:38.785056 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0317 23:17:38.785097 32978 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0317 23:17:38.785012 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0317 23:17:38.785262 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0317 23:17:38.785335 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:38.785390 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.785574 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:38.785626 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0317 23:17:38.785801 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:38.785867 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0317 23:17:38.785990 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.786102 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0317 23:17:38.786132 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.786229 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.786316 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0317 23:17:38.786416 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:38.786723 32978 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0317 23:17:38.786850 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:38.786992 32978 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0317 23:17:38.786988 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:38.787098 32978 api.go:53] PageSize not implemented W0317 23:17:38.787108 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:38.787237 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0317 23:17:38.787285 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0317 23:17:38.787068 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:38.787314 32978 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0317 23:17:38.787132 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:38.787343 32978 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0317 23:17:38.787370 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:38.787404 32978 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0317 23:17:38.787372 32978 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } W0317 23:17:38.787516 32978 api.go:53] PageSize not implemented I0317 23:17:38.787531 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:38.787532 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:38.787663 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0317 23:17:38.787833 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:38.787987 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:38.788069 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:38.788229 32978 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0317 23:17:38.788278 32978 api.go:53] PageSize not implemented I0317 23:17:38.788294 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:38.788320 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:38.788292 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:38.788348 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0317 23:17:38.788359 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0317 23:17:38.788370 32978 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0317 23:17:38.788336 32978 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0317 23:17:38.788390 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W0317 23:17:38.788458 32978 api.go:53] PageSize not implemented I0317 23:17:38.788487 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:38.788562 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:38.792855 32978 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0317 23:17:38.792966 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:38.793128 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:38.793205 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:38.793355 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:38.793413 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:38.793768 32978 executor.go:111] Tasks: 124 done / 132 total; 2 can run W0317 23:17:38.793846 32978 api.go:53] PageSize not implemented I0317 23:17:38.793863 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:38.794016 32978 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0317 23:17:38.794139 32978 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0317 23:17:38.796561 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0317 23:17:38.796612 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0317 23:17:38.796639 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:38.796666 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0317 23:17:38.796689 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0317 23:17:38.796713 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0317 23:17:38.796781 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0317 23:17:38.796816 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0317 23:17:38.796846 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0317 23:17:38.796871 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0317 23:17:38.796896 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:17:38.796917 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:17:38.796942 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:38.796967 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0317 23:17:38.796988 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0317 23:17:38.797013 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:38.797036 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:38.797061 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0317 23:17:38.797085 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0317 23:17:38.797112 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:38.797136 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:38.797157 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0317 23:17:38.797186 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:17:38.797209 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0317 23:17:38.797230 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:38.797255 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:38.797280 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0317 23:17:38.798383 32978 delete_cluster.go:128] Looking for cloud resources to delete W0317 23:17:38.798439 32978 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0317 23:17:38.798455 32978 keypairs.go:95] DescribeKeyPairs: { } I0317 23:17:38.798488 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.798531 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0317 23:17:38.798581 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.798627 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.798657 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.798686 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.798716 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.798747 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0317 23:17:38.798785 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.798824 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:38.798847 32978 natgateway.go:117] DescribeNatGateways: { } I0317 23:17:38.798880 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0317 23:17:38.798904 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W0317 23:17:38.798938 32978 api.go:53] PageSize not implemented I0317 23:17:38.798951 32978 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0317 23:17:38.798981 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:38.799000 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:38.799012 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0317 23:17:38.799040 32978 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0317 23:17:38.799058 32978 targetgroups.go:35] PageSize not implemented I0317 23:17:38.799071 32978 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" ] } I0317 23:17:38.799113 32978 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0317 23:17:38.799142 32978 iamrole.go:89] ListRoles: { } I0317 23:17:38.799177 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:38.799199 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:38.799235 32978 internetgateways.go:101] DescribeInternetGateways: { } I0317 23:17:38.799276 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:38.799304 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0317 23:17:38.799330 32978 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0317 23:17:38.799356 32978 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0317 23:17:38.799823 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0317 23:17:38.799893 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } autoscaling-group:nodes.private-shared-ip.example.com ok I0317 23:17:38.799932 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I0317 23:17:38.799958 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0317 23:17:38.799960 32978 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } autoscaling-group:bastion.private-shared-ip.example.com ok I0317 23:17:38.800025 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok volume:vol-2 ok I0317 23:17:38.799867 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.private-shared-ip.example.com. ok I0317 23:17:38.800048 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0317 23:17:38.799977 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } I0317 23:17:38.800120 32978 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } iam-instance-profile:masters.private-shared-ip.example.com ok I0317 23:17:38.800150 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } iam-instance-profile:bastions.private-shared-ip.example.com ok W0317 23:17:38.800160 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:38.800193 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0317 23:17:38.800191 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } autoscaling-config:lt-3 ok I0317 23:17:38.800190 32978 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0317 23:17:38.800229 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } load-balancer:api-private-shared-ip-exa-ohatqj ok iam-instance-profile:nodes.private-shared-ip.example.com ok I0317 23:17:38.800232 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I0317 23:17:38.800271 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0317 23:17:38.800349 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:38.800366 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I0317 23:17:38.800401 32978 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0317 23:17:38.800452 32978 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0317 23:17:38.800505 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0317 23:17:38.800554 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } W0317 23:17:38.800666 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:38.800685 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-2 ok I0317 23:17:38.800753 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I0317 23:17:38.800773 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } I0317 23:17:38.800791 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } subnet:subnet-2 ok I0317 23:17:38.800837 32978 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0317 23:17:38.800853 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0317 23:17:38.800843 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I0317 23:17:38.800880 32978 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } subnet:subnet-1 ok iam-role:nodes.private-shared-ip.example.com ok I0317 23:17:38.800917 32978 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0317 23:17:38.800928 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0317 23:17:38.800949 32978 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I0317 23:17:38.800931 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:38.800973 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I0317 23:17:38.801005 32978 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0317 23:17:38.801015 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0317 23:17:38.801034 32978 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I0317 23:17:38.800980 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } W0317 23:17:38.801091 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:38.801106 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0317 23:17:38.801176 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0317 23:17:38.801226 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecyclePrivateSharedIP (2.81s) === RUN TestLifecycleManyAddons I0317 23:17:38.801716 32978 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:17:38.801949 32978 internetgateways.go:66] CreateInternetGateway: { } I0317 23:17:38.801983 32978 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:17:38.802017 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:17:38.802046 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:17:38.802082 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:17:38.802112 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:17:38.802133 32978 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:17:38.802160 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:17:38.802199 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0317 23:17:38.823269 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:38.826131 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:38.826195 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:40.055899 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:40.710437 32978 iamrole.go:89] ListRoles: { } I0317 23:17:40.711083 32978 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0317 23:17:40.711482 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:40.711676 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:40.711722 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0317 23:17:40.711795 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:40.711812 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] } I0317 23:17:40.711911 32978 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0317 23:17:40.711896 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:40.711963 32978 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] } I0317 23:17:40.711996 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:40.712061 32978 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:17:40.712089 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:40.712215 32978 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0317 23:17:40.712306 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:40.712344 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:40.712469 32978 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0317 23:17:40.712604 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0317 23:17:40.712635 32978 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0317 23:17:40.712657 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:40.712703 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:40.712850 32978 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:17:40.712936 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:17:40.712976 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:40.720037 32978 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0317 23:17:40.720187 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:40.720308 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0317 23:17:40.720365 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0317 23:17:40.720508 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:40.720653 32978 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0317 23:17:40.720691 32978 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0317 23:17:40.720665 32978 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0317 23:17:40.720737 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0317 23:17:40.720771 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0317 23:17:40.720826 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:40.720867 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:40.720897 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:40.720964 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0317 23:17:40.721000 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0317 23:17:40.721047 32978 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0317 23:17:40.721116 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:40.721080 32978 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0317 23:17:40.721148 32978 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" } ] } I0317 23:17:40.721199 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:40.721296 32978 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0317 23:17:40.721304 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0317 23:17:40.721329 32978 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0317 23:17:40.721410 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:40.721455 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:40.721502 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:40.721537 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:40.721569 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:40.721708 32978 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:17:40.721782 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:40.722485 32978 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0317 23:17:40.725065 32978 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0317 23:17:40.725236 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:17:40.725366 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:17:40.725480 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0317 23:17:40.725628 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" }] }] } I0317 23:17:40.725766 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:17:40.725907 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0317 23:17:40.726073 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:40.726158 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:40.726324 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0317 23:17:40.726562 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:17:40.726680 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:40.726783 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:40.726868 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0317 23:17:40.727011 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:40.727119 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0317 23:17:40.727148 32978 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0317 23:17:40.727179 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:40.727252 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:40.727331 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" }] }] } I0317 23:17:40.727430 32978 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0317 23:17:40.727522 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0317 23:17:40.727623 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0317 23:17:40.727713 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" }] }] } I0317 23:17:40.727817 32978 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0317 23:17:40.727852 32978 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0317 23:17:40.727883 32978 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0317 23:17:40.727990 32978 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0317 23:17:40.728157 32978 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0317 23:17:40.728352 32978 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0317 23:17:40.728398 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:40.728432 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:40.728494 32978 dns.go:235] Pre-creating DNS records I0317 23:17:40.728520 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:40.733380 32978 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0317 23:17:40.736284 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:40.736353 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:41.978070 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:42.558857 32978 iamrole.go:89] ListRoles: { } I0317 23:17:42.559480 32978 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0317 23:17:42.561564 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.562091 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.562175 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:17:42.562199 32978 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:17:42.562258 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:42.562489 32978 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0317 23:17:42.562802 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.564426 32978 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0317 23:17:42.565097 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] }] } I0317 23:17:42.566906 32978 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0317 23:17:42.567004 32978 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0317 23:17:42.567025 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.567153 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.567253 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:42.567323 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I0317 23:17:42.567407 32978 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:17:42.567493 32978 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:17:42.567528 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0317 23:17:42.567640 32978 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0317 23:17:42.567637 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0317 23:17:42.567779 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:42.567830 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:42.571740 32978 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0317 23:17:42.572007 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:42.572206 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:42.572472 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:42.572773 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:42.572929 32978 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0317 23:17:42.572999 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:42.573127 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0317 23:17:42.573538 32978 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0317 23:17:42.573726 32978 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0317 23:17:42.573910 32978 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0317 23:17:42.576119 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0317 23:17:42.576168 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0317 23:17:42.576197 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0317 23:17:42.576221 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0317 23:17:42.576243 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0317 23:17:42.576263 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0317 23:17:42.576284 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0317 23:17:42.576309 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0317 23:17:42.576332 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0317 23:17:42.576358 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0317 23:17:42.576385 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0317 23:17:42.576408 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0317 23:17:42.576429 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0317 23:17:42.576452 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0317 23:17:42.576472 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:17:42.576496 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0317 23:17:42.576519 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:17:42.576542 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0317 23:17:42.576563 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0317 23:17:42.576583 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0317 23:17:42.576603 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0317 23:17:42.576626 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0317 23:17:42.576648 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:17:42.576671 32978 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0317 23:17:42.577965 32978 delete_cluster.go:128] Looking for cloud resources to delete W0317 23:17:42.578018 32978 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0317 23:17:42.578035 32978 keypairs.go:95] DescribeKeyPairs: { } I0317 23:17:42.578065 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.578101 32978 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0317 23:17:42.578138 32978 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.578194 32978 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.578229 32978 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.578267 32978 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.578298 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.578324 32978 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0317 23:17:42.578357 32978 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.578392 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0317 23:17:42.578419 32978 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0317 23:17:42.578451 32978 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0317 23:17:42.578477 32978 api.go:53] PageSize not implemented I0317 23:17:42.578493 32978 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0317 23:17:42.578515 32978 loadbalancers.go:35] PageSize not implemented I0317 23:17:42.578531 32978 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0317 23:17:42.578549 32978 targetgroups.go:35] PageSize not implemented I0317 23:17:42.578565 32978 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0317 23:17:42.578601 32978 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0317 23:17:42.578632 32978 iamrole.go:89] ListRoles: { } I0317 23:17:42.578666 32978 zones.go:93] ListHostedZonesPages { } I0317 23:17:42.578689 32978 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0317 23:17:42.578719 32978 internetgateways.go:101] DescribeInternetGateways: { } I0317 23:17:42.578755 32978 routetable.go:53] DescribeRouteTables: { } I0317 23:17:42.578780 32978 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:nodes.minimal.example.com ok I0317 23:17:42.579146 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0317 23:17:42.579220 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0317 23:17:42.579297 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0317 23:17:42.579338 32978 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0317 23:17:42.579370 32978 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0317 23:17:42.579173 32978 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok I0317 23:17:42.579232 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0317 23:17:42.579539 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:42.579566 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0317 23:17:42.579618 32978 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0317 23:17:42.579680 32978 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0317 23:17:42.579787 32978 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0317 23:17:42.579801 32978 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0317 23:17:42.579827 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok I0317 23:17:42.579930 32978 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0317 23:17:42.580005 32978 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0317 23:17:42.580057 32978 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0317 23:17:42.580128 32978 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0317 23:17:42.580198 32978 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0317 23:17:42.580228 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0317 23:17:42.580294 32978 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0317 23:17:42.580310 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0317 23:17:42.580336 32978 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0317 23:17:42.580362 32978 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0317 23:17:42.580393 32978 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0317 23:17:42.580403 32978 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0317 23:17:42.580422 32978 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0317 23:17:42.580485 32978 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0317 23:17:42.580567 32978 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0317 23:17:42.580640 32978 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (3.78s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 197.330s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.005s ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I0317 23:14:25.466616 33144 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.003s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.003s === RUN TestPodController I0317 23:14:25.489356 33147 pod.go:59] starting pod controller I0317 23:14:25.489507 33147 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) PASS I0317 23:14:25.489580 33147 pod.go:65] shutting down pod controller I0317 23:14:25.489599 33147 pod.go:107] Got stop signal ok k8s.io/kops/dns-controller/pkg/watchers 0.027s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.003s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00011c0b0} route53_test.go:93: Got zone list: [0xc00011c0e0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e000} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00011c1e0} route53_test.go:93: Got zone list: [0xc00011c210] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e010} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc00011c2e0} route53_test.go:170: Successfully added managed DNS zone: &{0xc0001241e0 0xc00013e028} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00011c460} route53_test.go:93: Got zone list: [0xc00011c490] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e040} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00011c5c0} route53_test.go:93: Got zone list: [0xc00011c5f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e060} route53_test.go:187: Successfully added resource record set: {0xc000148000 0xc00013e080} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00011c8a0} route53_test.go:93: Got zone list: [0xc00011c8d0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e108} route53_test.go:199: Successfully added resource record set: {0xc0001481b0 0xc00013e128} route53_test.go:118: Got 1 recordsets: [0xc00011ca70] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00011cbd0} route53_test.go:93: Got zone list: [0xc00011cc00] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e1c0} route53_test.go:221: Successfully added resource record set: {0xc000148360 0xc00013e1e0} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000148360 0xc00013e1e0}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00011cf90} route53_test.go:93: Got zone list: [0xc00011cfc0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e298} route53_test.go:246: Successfully removed resource set {0xc0001485a0 0xc00013e2b8} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00011d270} route53_test.go:93: Got zone list: [0xc00011d2a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e340} route53_test.go:264: Successfully removed resource set {0xc000148750 0xc00013e360} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00011d580} route53_test.go:93: Got zone list: [0xc00011d5b0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e3f0} commontests.go:192: Successfully added resource record set: {0xc000148900 0xc00013e410} commontests.go:45: Correctly replaced resource record {0xc000148900 0xc00013e410} -> {0xc000148a20 0xc00013e460} commontests.go:142: Got 1 recordsets: [0xc00011d8c0] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00011dac0} route53_test.go:93: Got zone list: [0xc00011daf0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e510} commontests.go:192: Successfully added resource record set: {0xc000148cf0 0xc00013e530} commontests.go:70: Correctly replaced resource record {0xc000148cf0 0xc00013e530} -> {0xc000148e10 0xc00013e580} commontests.go:142: Got 1 recordsets: [0xc00011de00] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0001600d0} route53_test.go:93: Got zone list: [0xc000160100] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e640} commontests.go:192: Successfully added resource record set: {0xc0001490e0 0xc00013e660} commontests.go:142: Got 2 recordsets: [0xc000160370 0xc000160390] commontests.go:142: Got 2 recordsets: [0xc000160400 0xc000160420] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0001605f0} route53_test.go:93: Got zone list: [0xc000160620] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc00013e760} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.027s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.026s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc000465620} clouddns_test.go:71: Got zone list: [0xc00000f458] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc00000f428} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc000465720} clouddns_test.go:71: Got zone list: [0xc00000f518] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc00000f4e8} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc000465820} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc0003cfb40 0xc00000f5d8} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc0004658e0} clouddns_test.go:71: Got zone list: [0xc00000f698] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc00000f668} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc000465a00} clouddns_test.go:71: Got zone list: [0xc00000f7d0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc00000f7a0} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc000465b40} clouddns_test.go:71: Got zone list: [0xc00000f938] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc00000f908} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc000465ca0} clouddns_test.go:71: Got zone list: [0xc00000fb48] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc00000fb18} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc000465e00} clouddns_test.go:71: Got zone list: [0xc00000fce0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc00000fcb0} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc000465f40} clouddns_test.go:71: Got zone list: [0xc00000fe48] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc00000fe18} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc0005ba120} clouddns_test.go:71: Got zone list: [0xc0007b6138] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc0007b6108} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc0005ba280} clouddns_test.go:71: Got zone list: [0xc0007b6408] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc0007b63d8} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc0005ba400} clouddns_test.go:71: Got zone list: [0xc0007b6738] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc0007b6708} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000d4238 0xc0005ba5e0} clouddns_test.go:71: Got zone list: [0xc0007b6b10] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003cf9c0 0xc0007b6ae0} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.035s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.026s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.025s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.050s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I0317 23:14:30.379467 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.379737 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.379781 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.379805 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.379830 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.379863 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.379890 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.379899 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.379921 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.379939 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.386858 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I0317 23:14:30.389676 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.389802 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.389823 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.389845 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.389859 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.389879 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.389898 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.389907 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.389923 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.389934 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.390641 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.01s) === RUN TestContainerdBuilder_Simple I0317 23:14:30.395384 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.395568 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.395598 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.395631 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.395656 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.395689 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.395718 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.395735 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.395759 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.395778 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.396937 33833 zones.go:93] ListHostedZonesPages { } I0317 23:14:30.398635 33833 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I0317 23:14:30.398650 33833 assetstore.go:111] bin/containerd I0317 23:14:30.398658 33833 assetstore.go:111] bin/containerd-shim I0317 23:14:30.398665 33833 assetstore.go:111] bin/containerd-shim-runc-v1 I0317 23:14:30.398673 33833 assetstore.go:111] bin/containerd-shim-runc-v2 I0317 23:14:30.398679 33833 assetstore.go:111] bin/containerd-stress I0317 23:14:30.398683 33833 assetstore.go:111] bin/ctr I0317 23:14:30.398727 33833 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I0317 23:14:30.398738 33833 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.01s) === RUN TestContainerdBuilder_Flatcar I0317 23:14:30.401682 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.401855 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.401885 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.401916 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.401940 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.401971 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.402003 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.402020 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.402046 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.402064 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.403198 33833 zones.go:93] ListHostedZonesPages { } I0317 23:14:30.404760 33833 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I0317 23:14:30.405869 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.406041 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.406069 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.406099 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.406121 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.406161 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.406188 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.406203 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.406225 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.406244 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.407426 33833 zones.go:93] ListHostedZonesPages { } I0317 23:14:30.408665 33833 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I0317 23:14:30.409237 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.409405 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.409432 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.409470 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.409494 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.409526 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.409553 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.409571 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.409594 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.409610 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.410291 33833 zones.go:93] ListHostedZonesPages { } I0317 23:14:30.411254 33833 assetstore.go:108] Matching assets for "^docker/": I0317 23:14:30.411265 33833 assetstore.go:111] docker/containerd I0317 23:14:30.411269 33833 assetstore.go:111] docker/containerd-shim I0317 23:14:30.411272 33833 assetstore.go:111] docker/ctr I0317 23:14:30.411275 33833 assetstore.go:111] docker/docker I0317 23:14:30.411277 33833 assetstore.go:111] docker/docker-init I0317 23:14:30.411280 33833 assetstore.go:111] docker/docker-proxy I0317 23:14:30.411282 33833 assetstore.go:111] docker/dockerd I0317 23:14:30.411284 33833 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.00s) === RUN TestDockerBuilder_LogFlags I0317 23:14:30.412951 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.413180 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.413214 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.413251 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.413279 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.413321 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.413354 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.413373 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.413401 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.413435 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.414417 33833 zones.go:93] ListHostedZonesPages { } I0317 23:14:30.415530 33833 assetstore.go:108] Matching assets for "^docker/": I0317 23:14:30.415544 33833 assetstore.go:111] docker/containerd I0317 23:14:30.415549 33833 assetstore.go:111] docker/containerd-shim I0317 23:14:30.415552 33833 assetstore.go:111] docker/ctr I0317 23:14:30.415554 33833 assetstore.go:111] docker/docker I0317 23:14:30.415557 33833 assetstore.go:111] docker/docker-init I0317 23:14:30.415559 33833 assetstore.go:111] docker/docker-proxy I0317 23:14:30.415562 33833 assetstore.go:111] docker/dockerd I0317 23:14:30.415565 33833 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.00s) === RUN TestDockerBuilder_SkipInstall I0317 23:14:30.417501 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.417631 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.417654 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.417681 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.417696 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.417716 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.417737 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.417752 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.417767 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.417785 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.418669 33833 zones.go:93] ListHostedZonesPages { } I0317 23:14:30.419732 33833 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I0317 23:14:30.419979 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.420191 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.420223 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.420254 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.420277 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.420305 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.420334 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.420359 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.420382 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.420397 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.421423 33833 zones.go:93] ListHostedZonesPages { } I0317 23:14:30.422779 33833 assetstore.go:108] Matching assets for "^docker/": I0317 23:14:30.422800 33833 assetstore.go:111] docker/docker I0317 23:14:30.422807 33833 assetstore.go:111] docker/docker-containerd I0317 23:14:30.422812 33833 assetstore.go:111] docker/docker-containerd-ctr I0317 23:14:30.422817 33833 assetstore.go:111] docker/docker-containerd-shim I0317 23:14:30.422822 33833 assetstore.go:111] docker/docker-init I0317 23:14:30.422826 33833 assetstore.go:111] docker/docker-proxy I0317 23:14:30.422830 33833 assetstore.go:111] docker/docker-runc I0317 23:14:30.422834 33833 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.01s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I0317 23:14:30.428620 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.428821 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.428853 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.428889 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.428916 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.428951 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.428983 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.429001 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.429027 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.429046 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.431558 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.01s) === RUN TestDockerHooksBuilder I0317 23:14:30.434279 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.434458 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.434491 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.434525 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.434552 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.434587 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.434619 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.434636 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.434662 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.434683 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.436712 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.01s) === RUN TestKopsControllerBuilder I0317 23:14:30.439426 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.439615 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.439644 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.439682 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.439707 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.439740 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.439770 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.439786 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.439813 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.439834 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.441685 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.01s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I0317 23:14:30.447946 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.448087 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.448108 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.448129 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.448143 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.448165 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.448185 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.448194 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.448209 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.448220 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.449365 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.01s) === RUN TestAuditConfigAPIServerBuilder I0317 23:14:30.454459 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.454569 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.454587 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.454607 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.454620 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.454638 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.454655 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.454663 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.454676 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.454687 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.455909 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I0317 23:14:30.462326 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.462534 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.462569 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.462612 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.462640 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.462673 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.462706 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.462725 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.462754 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.462772 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.464928 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I0317 23:14:30.472383 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.472586 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.472620 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.472654 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.472681 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.472714 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.472749 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.472766 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.472792 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.472812 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.474666 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I0317 23:14:30.480064 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.480197 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.480223 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.480254 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.480275 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.480303 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.480328 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.480343 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.480368 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.480383 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.481722 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I0317 23:14:30.494642 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.494856 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.494894 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.494935 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.494963 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.495000 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.495035 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.495054 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.495080 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.495098 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.497217 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I0317 23:14:30.505724 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:30.505915 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:30.505945 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:30.505975 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:30.505991 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:30.506012 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:30.506030 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:30.506041 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:30.506058 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:30.506069 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:30.507260 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.56s) === RUN TestKubeAPIServerBuilderARM64 I0317 23:14:32.065786 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:32.065959 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:32.065987 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:32.066019 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:32.066042 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:32.066068 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:32.066093 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:32.066107 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:32.066130 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:32.066145 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:32.067677 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.11s) === RUN TestKubeControllerManagerBuilder I0317 23:14:33.179244 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:33.179380 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:33.179402 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:33.179426 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:33.179443 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:33.179468 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:33.179488 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:33.179499 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:33.179517 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:33.179530 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:33.180684 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I0317 23:14:33.186465 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:33.186587 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:33.186606 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:33.186628 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:33.186644 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:33.186665 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:33.186685 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:33.186695 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:33.186711 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:33.186728 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:33.187865 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.11s) === RUN TestKubeControllerManagerBuilderARM64 I0317 23:14:34.300646 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:34.300808 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:34.300835 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:34.300870 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:34.300891 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:34.300918 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:34.300943 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:34.300956 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:34.300977 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:34.300991 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:34.302468 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.12s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I0317 23:14:35.424227 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:35.424418 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:35.424449 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:35.424479 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:35.424504 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:35.424535 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:35.424561 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:35.424579 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:35.424607 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:35.424625 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:35.426394 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I0317 23:14:35.430419 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:35.430562 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:35.430584 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:35.430609 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:35.430631 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:35.430656 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:35.430677 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:35.430694 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:35.430717 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:35.430732 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:35.432328 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.11s) === RUN TestKubeProxyBuilderARM64 I0317 23:14:36.541182 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:36.541408 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:36.541444 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:36.541484 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:36.541513 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:36.541551 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:36.541585 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:36.541605 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:36.541633 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:36.541656 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:36.543772 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.11s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I0317 23:14:37.653045 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:37.653279 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:37.653319 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:37.653368 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:37.653403 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:37.653462 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:37.653498 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:37.653521 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:37.653552 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:37.653575 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:37.655810 33833 zones.go:93] ListHostedZonesPages { } W0317 23:14:37.659309 33833 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I0317 23:14:37.661607 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:37.661799 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:37.661831 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:37.661862 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:37.661890 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:37.661927 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:37.661957 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:37.661978 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:37.662004 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:37.662024 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:37.664133 33833 zones.go:93] ListHostedZonesPages { } W0317 23:14:38.770179 33833 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.11s) === RUN TestKubeSchedulerBuilderARM64 I0317 23:14:38.772376 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:38.772584 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:38.772619 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:38.772658 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:38.772691 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:38.772728 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:38.772759 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:38.772781 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:38.772809 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:38.772831 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:38.774884 33833 zones.go:93] ListHostedZonesPages { } W0317 23:14:39.884251 33833 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.11s) === RUN TestKubectlBuilder I0317 23:14:39.886593 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:39.886837 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:39.886877 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:39.886918 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:39.886952 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:39.886993 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:39.887027 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:39.887047 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:39.887075 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:39.887099 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:39.889156 33833 zones.go:93] ListHostedZonesPages { } I0317 23:14:39.891517 33833 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I0317 23:14:39.897011 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:39.897200 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:39.897229 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:39.897266 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:39.897294 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:39.897326 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:39.897352 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:39.897372 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:39.897397 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:39.897415 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:39.899004 33833 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I0317 23:14:39.903556 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:39.903735 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:39.903765 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:39.903794 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:39.903820 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:39.903851 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:39.903879 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:39.903901 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:39.903927 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:39.903946 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:39.905454 33833 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.01s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I0317 23:14:39.909827 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:39.910011 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:39.910044 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:39.910074 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:39.910125 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:39.910160 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:39.910187 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:39.910207 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:39.910231 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:39.910250 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:39.912199 33833 zones.go:93] ListHostedZonesPages { } I0317 23:14:39.914474 33833 assetstore.go:108] Matching assets for "protokube$": I0317 23:14:39.914497 33833 assetstore.go:111] /opt/kops/bin/protokube I0317 23:14:39.914510 33833 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I0317 23:14:39.914534 33833 assetstore.go:108] Matching assets for "channels$": I0317 23:14:39.914544 33833 assetstore.go:111] /opt/kops/bin/channels I0317 23:14:39.914553 33833 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I0317 23:14:39.916249 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:39.916424 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:39.916457 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:39.916484 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:39.916514 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:39.916546 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:39.916574 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:39.916596 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:39.916620 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:39.916640 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:39.918550 33833 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I0317 23:14:39.921702 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:39.921888 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:39.921917 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:39.921945 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:39.921973 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:39.922005 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:39.922032 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:39.922052 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:39.922076 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:39.922094 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:39.924350 33833 zones.go:93] ListHostedZonesPages { } I0317 23:14:39.926559 33833 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.01s) === RUN TestUpdateServiceBuilderExternal I0317 23:14:39.927077 33833 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:39.927248 33833 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:39.927276 33833 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:39.927303 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:39.927332 33833 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:39.927367 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:39.927394 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:39.927414 33833 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:39.927438 33833 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:39.927455 33833 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:39.929378 33833 zones.go:93] ListHostedZonesPages { } I0317 23:14:39.931601 33833 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.00s) PASS ok k8s.io/kops/nodeup/pkg/model 9.629s ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.032s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.026s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.025s ? k8s.io/kops/pkg/apis/kops/registry [no test files] === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E0317 23:14:30.316543 33835 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E0317 23:14:30.316639 33835 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.008s ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I0317 23:14:30.367579 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367651 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367675 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367690 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367704 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I0317 23:14:30.367819 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367838 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367853 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367864 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367877 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367887 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367900 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367915 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367929 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367940 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367949 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367963 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367978 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.367987 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.368002 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.368019 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.368034 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.368043 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0317 23:14:30.368051 33838 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I0317 23:14:30.368143 33838 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I0317 23:14:30.368180 33838 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.068s ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.011s ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W0317 23:14:30.350004 33840 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W0317 23:14:30.350844 33840 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W0317 23:14:30.351450 33840 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W0317 23:14:30.352357 33840 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W0317 23:14:30.353104 33840 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W0317 23:14:30.353737 33840 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host W0317 23:14:30.354293 33840 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E0317 23:14:30.354741 33840 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E0317 23:14:30.354751 33840 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E0317 23:14:30.354758 33840 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E0317 23:14:30.354765 33840 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.047s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.004s ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.061s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.026s ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.096s ? k8s.io/kops/pkg/commands/commandutils [no test files] === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.086s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.028s ? k8s.io/kops/pkg/configserver [no test files] === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.006s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.005s ? k8s.io/kops/pkg/dump [no test files] === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.034s === RUN TestFlagToFalse I0317 23:14:30.331741 34073 featureflag_test.go:32] Created flag Unittest1 I0317 23:14:30.331787 34073 featureflag.go:164] FeatureFlag "UnitTest1"=false I0317 23:14:30.331797 34073 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I0317 23:14:30.331887 34073 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.004s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.026s === RUN TestRenderInstanceGroupZones W0317 23:14:30.424533 34387 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.021s === RUN TestWarmPoolOnlyRoll I0317 23:14:42.591127 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.591200 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.591215 35703 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I0317 23:14:42.591590 35703 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0317 23:14:42.591604 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.592713 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.592733 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.597940 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.597988 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.598003 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.598014 35703 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0317 23:14:42.599520 35703 instancegroups.go:431] Draining the node: "master-1a.local". I0317 23:14:42.599992 35703 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0317 23:14:42.600068 35703 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0317 23:14:42.600102 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.601208 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.601226 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.606416 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.606469 35703 instancegroups.go:431] Draining the node: "master-1b.local". I0317 23:14:42.607031 35703 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0317 23:14:42.607102 35703 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0317 23:14:42.607128 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.608266 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.608288 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.613485 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.613529 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.613542 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.613551 35703 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0317 23:14:42.614106 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:42.614540 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:42.614564 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.615672 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.615691 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.620870 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.620917 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:42.621323 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:42.621340 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.622828 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.622846 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.628046 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.628104 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:42.628737 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:42.628761 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.629845 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.629862 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.635055 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.635085 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.635100 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.635112 35703 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0317 23:14:42.635801 35703 instancegroups.go:431] Draining the node: "node-2a.local". I0317 23:14:42.636266 35703 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0317 23:14:42.636289 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.637410 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.637436 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.642621 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.642685 35703 instancegroups.go:431] Draining the node: "node-2b.local". I0317 23:14:42.643310 35703 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0317 23:14:42.643335 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.644455 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.644476 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.649666 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.649709 35703 instancegroups.go:431] Draining the node: "node-2c.local". I0317 23:14:42.650260 35703 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0317 23:14:42.650285 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.651395 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.651416 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.656620 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.656663 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I0317 23:14:42.657033 35703 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0317 23:14:42.657054 35703 instancegroups.go:469] waiting for 1ms after terminating instance W0317 23:14:42.658164 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0317 23:14:42.658187 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0317 23:14:42.658200 35703 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0317 23:14:42.658207 35703 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0317 23:14:42.658216 35703 instancegroups.go:469] waiting for 1ms after terminating instance W0317 23:14:42.659326 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0317 23:14:42.659376 35703 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0317 23:14:42.659385 35703 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0317 23:14:42.659400 35703 instancegroups.go:469] waiting for 1ms after terminating instance W0317 23:14:42.660505 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0317 23:14:42.660520 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0317 23:14:42.660536 35703 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0317 23:14:42.660542 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:42.660551 35703 instancegroups.go:469] waiting for 1ms after terminating instance W0317 23:14:42.661643 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0317 23:14:42.661664 35703 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0317 23:14:42.661671 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:42.661683 35703 instancegroups.go:469] waiting for 1ms after terminating instance W0317 23:14:42.662786 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0317 23:14:42.662804 35703 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0317 23:14:42.662810 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:42.662818 35703 instancegroups.go:469] waiting for 1ms after terminating instance W0317 23:14:42.663909 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0317 23:14:42.663924 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0317 23:14:42.663948 35703 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0317 23:14:42.663957 35703 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0317 23:14:42.663971 35703 instancegroups.go:469] waiting for 1ms after terminating instance W0317 23:14:42.665062 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0317 23:14:42.665089 35703 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0317 23:14:42.665096 35703 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0317 23:14:42.665107 35703 instancegroups.go:469] waiting for 1ms after terminating instance W0317 23:14:42.666192 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0317 23:14:42.666212 35703 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0317 23:14:42.666219 35703 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0317 23:14:42.666231 35703 instancegroups.go:469] waiting for 1ms after terminating instance W0317 23:14:42.667322 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0317 23:14:42.667341 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I0317 23:14:42.667580 35703 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0317 23:14:42.667596 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.668722 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.668758 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.668774 35703 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.668810 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.668821 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.668830 35703 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.668837 35703 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0317 23:14:42.669342 35703 instancegroups.go:431] Draining the node: "master-1a.local". I0317 23:14:42.669736 35703 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0317 23:14:42.669778 35703 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0317 23:14:42.669795 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.670897 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.670916 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.670927 35703 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.670947 35703 instancegroups.go:431] Draining the node: "master-1b.local". I0317 23:14:42.671356 35703 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0317 23:14:42.671384 35703 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0317 23:14:42.671398 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.672485 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.672500 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.672510 35703 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.672523 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.672532 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.672539 35703 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.672547 35703 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0317 23:14:42.673251 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:42.673645 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:42.673662 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.674757 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.674771 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.674778 35703 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.674797 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:42.675064 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:42.675078 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.676164 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.676179 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.676187 35703 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.676200 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:42.676579 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:42.676595 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.677697 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.677714 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.677724 35703 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.677732 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.677738 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.677745 35703 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.677751 35703 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0317 23:14:42.678209 35703 instancegroups.go:431] Draining the node: "node-2a.local". I0317 23:14:42.678574 35703 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0317 23:14:42.678589 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.679680 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.679693 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.679701 35703 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.679716 35703 instancegroups.go:431] Draining the node: "node-2b.local". I0317 23:14:42.679991 35703 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0317 23:14:42.680003 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.681104 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.681124 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.681138 35703 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.681159 35703 instancegroups.go:431] Draining the node: "node-2c.local". I0317 23:14:42.681585 35703 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0317 23:14:42.681601 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.682712 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.682731 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0317 23:14:42.682743 35703 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0317 23:14:42.682756 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I0317 23:14:42.682912 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I0317 23:14:42.683015 35703 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0317 23:14:42.683025 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.684152 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.684175 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.689363 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.689408 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.689417 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.689423 35703 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0317 23:14:42.689755 35703 instancegroups.go:431] Draining the node: "master-1a.local". I0317 23:14:42.690003 35703 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0317 23:14:42.690033 35703 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0317 23:14:42.690046 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.691178 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.691201 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.696349 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.696390 35703 instancegroups.go:431] Draining the node: "master-1b.local". I0317 23:14:42.696774 35703 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0317 23:14:42.696811 35703 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0317 23:14:42.696825 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.697927 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.697949 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.703143 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.703180 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.703192 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.703201 35703 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0317 23:14:42.703933 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:42.704423 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:42.704452 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.705559 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.705575 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.710771 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.710827 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:42.711389 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:42.711412 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.714800 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.714834 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.720013 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.720059 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:42.720639 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:42.720662 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.721876 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.721914 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.727318 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.727348 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.727357 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.727364 35703 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0317 23:14:42.727852 35703 instancegroups.go:431] Draining the node: "node-2a.local". I0317 23:14:42.728216 35703 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0317 23:14:42.728240 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.729348 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.729370 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.734549 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.734607 35703 instancegroups.go:431] Draining the node: "node-2b.local". I0317 23:14:42.735281 35703 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0317 23:14:42.735315 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.736420 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.736439 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.741706 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.741749 35703 instancegroups.go:431] Draining the node: "node-2c.local". I0317 23:14:42.742179 35703 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0317 23:14:42.742196 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.743297 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.743320 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.748515 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.748555 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.07s) === RUN TestRollingUpdateEmptyGroup I0317 23:14:42.748700 35703 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I0317 23:14:42.750027 35703 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0317 23:14:42.750786 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.751869 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.751889 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0317 23:14:42.751898 35703 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I0317 23:14:42.752051 35703 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0317 23:14:42.752062 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.753159 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.753174 35703 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0317 23:14:42.753186 35703 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I0317 23:14:42.753310 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.753323 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0317 23:14:42.753331 35703 instancegroups.go:509] Cluster did not validate within 0s E0317 23:14:42.753340 35703 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I0317 23:14:42.753446 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.753457 35703 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0317 23:14:42.753466 35703 instancegroups.go:509] Cluster did not validate within 0s E0317 23:14:42.753474 35703 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I0317 23:14:42.753586 35703 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0317 23:14:42.753600 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.754713 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.754731 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.759907 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.759951 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.759962 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.759968 35703 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0317 23:14:42.760347 35703 instancegroups.go:431] Draining the node: "master-1a.local". I0317 23:14:42.760610 35703 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0317 23:14:42.760660 35703 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0317 23:14:42.760673 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.761894 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.761931 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0317 23:14:42.761947 35703 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I0317 23:14:42.762177 35703 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0317 23:14:42.762194 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.763333 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.763356 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.768537 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.768590 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.768605 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.768614 35703 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0317 23:14:42.769109 35703 instancegroups.go:431] Draining the node: "master-1a.local". I0317 23:14:42.769498 35703 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0317 23:14:42.769543 35703 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0317 23:14:42.769566 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.770771 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.770808 35703 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0317 23:14:42.770825 35703 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I0317 23:14:42.771066 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.771078 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.771085 35703 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0317 23:14:42.771672 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:42.772082 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:42.772101 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.773215 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.773244 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.778415 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.778453 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:42.778888 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:42.778905 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.780010 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.780042 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.785223 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.785277 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:42.785872 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:42.785895 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.787031 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.787055 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.793468 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.793504 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I0317 23:14:42.793753 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.793770 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0317 23:14:42.793783 35703 instancegroups.go:509] Cluster did not validate within 0s E0317 23:14:42.793793 35703 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I0317 23:14:42.793909 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.793923 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0317 23:14:42.793930 35703 instancegroups.go:509] Cluster did not validate within 0s E0317 23:14:42.793939 35703 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I0317 23:14:42.794063 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.794077 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0317 23:14:42.794086 35703 instancegroups.go:509] Cluster did not validate within 0s E0317 23:14:42.794096 35703 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I0317 23:14:42.794238 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.794249 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.794256 35703 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0317 23:14:42.794863 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:42.795306 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:42.795324 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.796434 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.796452 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.801629 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.801667 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:42.802204 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:42.802225 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.803316 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.803330 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.808480 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.808505 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:42.808931 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:42.808948 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.810035 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.810047 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.815222 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.815238 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.815250 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0317 23:14:42.815261 35703 instancegroups.go:509] Cluster did not validate within 0s E0317 23:14:42.815274 35703 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I0317 23:14:42.815469 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.815484 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.815491 35703 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0317 23:14:42.815889 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:42.816128 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:42.816141 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.817246 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.817265 35703 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0317 23:14:42.817277 35703 instancegroups.go:509] Cluster did not validate within 0s E0317 23:14:42.817288 35703 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I0317 23:14:42.817400 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.817414 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.817422 35703 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0317 23:14:42.817957 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:42.818353 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:42.818371 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.819492 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.819504 35703 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0317 23:14:42.819512 35703 instancegroups.go:509] Cluster did not validate within 0s E0317 23:14:42.819518 35703 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I0317 23:14:42.819617 35703 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0317 23:14:42.819628 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.820722 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.820743 35703 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0317 23:14:42.821844 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.827045 35703 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0317 23:14:42.828167 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.833384 35703 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0317 23:14:42.834538 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.839727 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.839774 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.839789 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.839795 35703 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0317 23:14:42.840170 35703 instancegroups.go:431] Draining the node: "master-1a.local". I0317 23:14:42.840415 35703 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0317 23:14:42.840448 35703 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0317 23:14:42.840460 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.841588 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.841602 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.846796 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.846854 35703 instancegroups.go:431] Draining the node: "master-1b.local". I0317 23:14:42.847373 35703 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0317 23:14:42.847422 35703 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0317 23:14:42.847441 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.848556 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.848589 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.853780 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.853810 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.853825 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.853834 35703 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0317 23:14:42.854448 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:42.854931 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:42.854952 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.856051 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.856072 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.861250 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.861301 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:42.861876 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:42.861897 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.863026 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.863054 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.868242 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.868292 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:42.868843 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:42.868863 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.869998 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.870020 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.875189 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.875213 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.875229 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.875244 35703 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0317 23:14:42.875805 35703 instancegroups.go:431] Draining the node: "node-2a.local". I0317 23:14:42.876235 35703 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0317 23:14:42.876255 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.877379 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.877400 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.882548 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.882595 35703 instancegroups.go:431] Draining the node: "node-2b.local". I0317 23:14:42.883143 35703 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0317 23:14:42.883164 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.884230 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.884250 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.889407 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.889442 35703 instancegroups.go:431] Draining the node: "node-2c.local". I0317 23:14:42.889978 35703 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0317 23:14:42.889998 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.891124 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.891145 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.896335 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.896370 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I0317 23:14:42.896614 35703 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0317 23:14:42.896631 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.898306 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.898325 35703 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0317 23:14:42.899405 35703 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0317 23:14:42.900492 35703 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0317 23:14:42.901590 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.906769 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.906823 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.906838 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.906847 35703 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0317 23:14:42.907273 35703 instancegroups.go:431] Draining the node: "master-1a.local". I0317 23:14:42.907536 35703 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0317 23:14:42.907572 35703 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0317 23:14:42.907586 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.908671 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.908715 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.913879 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.913919 35703 instancegroups.go:431] Draining the node: "master-1b.local". I0317 23:14:42.914298 35703 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0317 23:14:42.914331 35703 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0317 23:14:42.914344 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.915476 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.915493 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.920680 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.920707 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.920718 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.920726 35703 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0317 23:14:42.921327 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:42.921753 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:42.921774 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.923114 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.923144 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.928335 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.928375 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:42.928757 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:42.928774 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.929888 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.929906 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.935087 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.935145 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:42.935716 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:42.935737 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.936848 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.936864 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.942046 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.942068 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.942077 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.942083 35703 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0317 23:14:42.942477 35703 instancegroups.go:431] Draining the node: "node-2a.local". I0317 23:14:42.942747 35703 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0317 23:14:42.942761 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.943877 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.943889 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.949040 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.949076 35703 instancegroups.go:431] Draining the node: "node-2b.local". I0317 23:14:42.949477 35703 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0317 23:14:42.949493 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.950617 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.950630 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.955812 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.955840 35703 instancegroups.go:431] Draining the node: "node-2c.local". I0317 23:14:42.956205 35703 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0317 23:14:42.956220 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.957343 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.957355 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.962527 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.962563 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I0317 23:14:42.962857 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.962866 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.962871 35703 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0317 23:14:42.963195 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:42.963472 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:42.963487 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.964572 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.964586 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.969745 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.969772 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:42.970163 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:42.970179 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.971301 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.971314 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.976489 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.976509 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I0317 23:14:42.976662 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.976675 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.976682 35703 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0317 23:14:42.976997 35703 instancegroups.go:431] Draining the node: "master-1a.local". I0317 23:14:42.977266 35703 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0317 23:14:42.977301 35703 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0317 23:14:42.977313 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.978447 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.978459 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.983637 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.983669 35703 instancegroups.go:431] Draining the node: "master-1b.local". I0317 23:14:42.984031 35703 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0317 23:14:42.984079 35703 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0317 23:14:42.984090 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:42.985220 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.985231 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.990402 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.990423 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I0317 23:14:42.990602 35703 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W0317 23:14:42.990619 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0317 23:14:42.990626 35703 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W0317 23:14:42.990632 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0317 23:14:42.990639 35703 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W0317 23:14:42.990643 35703 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0317 23:14:42.990649 35703 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0317 23:14:42.990654 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I0317 23:14:42.990747 35703 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I0317 23:14:42.990766 35703 instancegroups.go:203] waiting for 1ms after detaching instance I0317 23:14:42.991895 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.991907 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:42.997090 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.997115 35703 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I0317 23:14:42.997153 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.997164 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.997172 35703 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0317 23:14:42.997651 35703 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I0317 23:14:42.997664 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.997673 35703 instancegroups.go:540] Cluster validated. I0317 23:14:42.997679 35703 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0317 23:14:42.998067 35703 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0317 23:14:42.998091 35703 instancegroups.go:203] waiting for 1ms after detaching instance I0317 23:14:42.999185 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:42.999200 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:43.004313 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.004333 35703 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I0317 23:14:43.004341 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.004348 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.004354 35703 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0317 23:14:43.004739 35703 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I0317 23:14:43.004766 35703 instancegroups.go:203] waiting for 1ms after detaching instance I0317 23:14:43.005860 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.005876 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:43.011073 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.011091 35703 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0317 23:14:43.011103 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I0317 23:14:43.011252 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.011263 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.011271 35703 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0317 23:14:43.012017 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:43.012281 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:43.012298 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.013398 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.013436 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.013459 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:43.013468 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:43.014076 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:43.014212 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:43.014231 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.015317 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.015340 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.115705 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.115746 35703 instancegroups.go:431] Draining the node: "node-1e.local". I0317 23:14:43.115783 35703 instancegroups.go:431] Draining the node: "node-1d.local". I0317 23:14:43.116151 35703 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0317 23:14:43.116355 35703 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0317 23:14:43.116372 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.117465 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.117487 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.117507 35703 instancegroups.go:431] Draining the node: "node-1f.local". I0317 23:14:43.117942 35703 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0317 23:14:43.117964 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.119096 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.119119 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.219428 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.219471 35703 instancegroups.go:431] Draining the node: "node-1g.local". I0317 23:14:43.219898 35703 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0317 23:14:43.219921 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.221033 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.221069 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.221084 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I0317 23:14:43.221255 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.221272 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.221281 35703 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0317 23:14:43.222239 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:43.222278 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:43.222759 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:43.222847 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:43.222862 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.223996 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.224023 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.324379 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.324426 35703 instancegroups.go:431] Draining the node: "node-1d.local". I0317 23:14:43.324456 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:43.324826 35703 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0317 23:14:43.325021 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:43.325037 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.326128 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.326148 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.326162 35703 instancegroups.go:431] Draining the node: "node-1e.local". I0317 23:14:43.326473 35703 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0317 23:14:43.326490 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.327617 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.327642 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.427925 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.427978 35703 instancegroups.go:431] Draining the node: "node-1f.local". I0317 23:14:43.428398 35703 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0317 23:14:43.428429 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.429618 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.429648 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.429658 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I0317 23:14:43.429850 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.429874 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.429885 35703 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I0317 23:14:43.430737 35703 instancegroups.go:431] Draining the node: "master-1a.local". I0317 23:14:43.431000 35703 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0317 23:14:43.431021 35703 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0317 23:14:43.431033 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.432181 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.432195 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.432210 35703 instancegroups.go:431] Draining the node: "master-1c.local". I0317 23:14:43.432266 35703 instancegroups.go:431] Draining the node: "master-1b.local". I0317 23:14:43.432646 35703 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0317 23:14:43.432677 35703 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0317 23:14:43.432767 35703 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I0317 23:14:43.432783 35703 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I0317 23:14:43.432796 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.433930 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.433966 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.534376 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.534429 35703 instancegroups.go:431] Draining the node: "master-1e.local". I0317 23:14:43.534457 35703 instancegroups.go:431] Draining the node: "master-1d.local". I0317 23:14:43.534802 35703 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I0317 23:14:43.534840 35703 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I0317 23:14:43.535053 35703 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I0317 23:14:43.535071 35703 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I0317 23:14:43.535084 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.536230 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.536268 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.536289 35703 instancegroups.go:431] Draining the node: "master-1f.local". I0317 23:14:43.536622 35703 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I0317 23:14:43.536651 35703 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I0317 23:14:43.536666 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.537804 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.537827 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.638197 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.638237 35703 instancegroups.go:431] Draining the node: "master-1g.local". I0317 23:14:43.640332 35703 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I0317 23:14:43.640414 35703 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I0317 23:14:43.640436 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.641547 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.641574 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.641585 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I0317 23:14:43.641727 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.641742 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.641747 35703 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0317 23:14:43.642358 35703 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0317 23:14:43.642386 35703 instancegroups.go:203] waiting for 1ms after detaching instance I0317 23:14:43.643467 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.643488 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.643495 35703 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0317 23:14:43.643521 35703 instancegroups.go:203] waiting for 1ms after detaching instance I0317 23:14:43.644629 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.644642 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.644657 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:43.644666 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:43.644943 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:43.645157 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:43.645173 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.646297 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.646330 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.746472 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.746533 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:43.746531 35703 instancegroups.go:431] Draining the node: "node-1d.local". I0317 23:14:43.746941 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:43.747145 35703 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0317 23:14:43.747162 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.748304 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.748323 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.748335 35703 instancegroups.go:431] Draining the node: "node-1e.local". I0317 23:14:43.748630 35703 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0317 23:14:43.748648 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.749768 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.749792 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.850140 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.850197 35703 instancegroups.go:431] Draining the node: "node-1f.local". I0317 23:14:43.850805 35703 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0317 23:14:43.850850 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.851999 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.852018 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.852030 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I0317 23:14:43.852168 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.852181 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.852186 35703 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0317 23:14:43.852957 35703 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0317 23:14:43.852986 35703 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0317 23:14:43.853005 35703 instancegroups.go:203] waiting for 1ms after detaching instance I0317 23:14:43.854109 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.854128 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.854146 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:43.854154 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:43.854737 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:43.854839 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:43.854853 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.855947 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.855976 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.956360 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.956414 35703 instancegroups.go:431] Draining the node: "node-1d.local". I0317 23:14:43.956432 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:43.957009 35703 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0317 23:14:43.957118 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:43.957136 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.958304 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.958332 35703 instancegroups.go:540] Cluster validated. I0317 23:14:43.958358 35703 instancegroups.go:431] Draining the node: "node-1e.local". I0317 23:14:43.958800 35703 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0317 23:14:43.958830 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:43.959962 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:43.959983 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.060602 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.060647 35703 instancegroups.go:431] Draining the node: "node-1f.local". I0317 23:14:44.061042 35703 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0317 23:14:44.061068 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.062202 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.062221 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.062232 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I0317 23:14:44.062367 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.062376 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.062381 35703 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0317 23:14:44.062664 35703 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0317 23:14:44.062680 35703 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I0317 23:14:44.062697 35703 instancegroups.go:203] waiting for 1ms after detaching instance I0317 23:14:44.063820 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.063832 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:44.069018 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.069047 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:44.069051 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:44.069659 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:44.069685 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.069817 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:44.069831 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.070812 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.070825 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:44.076132 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.076152 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I0317 23:14:44.076308 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.076317 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.076322 35703 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0317 23:14:44.076574 35703 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E0317 23:14:44.076598 35703 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I0317 23:14:44.076602 35703 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E0317 23:14:44.076614 35703 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I0317 23:14:44.076623 35703 instancegroups.go:203] waiting for 1ms after detaching instance I0317 23:14:44.077743 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.077755 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:44.082942 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.082966 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:44.082992 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:44.083348 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:44.083363 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.083598 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:44.083610 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.084481 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.084494 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:44.089751 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.089768 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I0317 23:14:44.089904 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.089916 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.089920 35703 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I0317 23:14:44.090332 35703 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0317 23:14:44.090363 35703 instancegroups.go:203] waiting for 1ms after detaching instance I0317 23:14:44.091488 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.091502 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.091507 35703 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0317 23:14:44.091525 35703 instancegroups.go:203] waiting for 1ms after detaching instance I0317 23:14:44.092634 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.092647 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.092661 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:44.092668 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:44.092698 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:44.092938 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:44.092955 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.093186 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:44.093202 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.093476 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:44.093494 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.094069 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.194683 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.194726 35703 instancegroups.go:431] Draining the node: "node-1d.local". I0317 23:14:44.195123 35703 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0317 23:14:44.195146 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.196284 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.196302 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.196315 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I0317 23:14:44.196429 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.196440 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.196445 35703 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0317 23:14:44.197119 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:44.197345 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:44.197361 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.198492 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.198507 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.198519 35703 instancegroups.go:431] Draining the node: "node-1e.local". I0317 23:14:44.198527 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:44.198804 35703 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0317 23:14:44.198998 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:44.199011 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.200131 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.200153 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.300734 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.300794 35703 instancegroups.go:431] Draining the node: "node-1g.local". I0317 23:14:44.300817 35703 instancegroups.go:431] Draining the node: "node-1f.local". I0317 23:14:44.301652 35703 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0317 23:14:44.301787 35703 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0317 23:14:44.301811 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.302933 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.302957 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.302977 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:44.303440 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:44.303470 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.304578 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.304628 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.405389 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.405459 35703 instancegroups.go:431] Draining the node: "node-1d.local". I0317 23:14:44.405986 35703 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0317 23:14:44.406011 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.407123 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.407149 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.407162 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I0317 23:14:44.407326 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.407338 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.407346 35703 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0317 23:14:44.407356 35703 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0317 23:14:44.407361 35703 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0317 23:14:44.407374 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I0317 23:14:44.407462 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.407474 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.407481 35703 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0317 23:14:44.407929 35703 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0317 23:14:44.407941 35703 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0317 23:14:44.407946 35703 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0317 23:14:44.407975 35703 instancegroups.go:431] Draining the node: "node-1a.local". I0317 23:14:44.408325 35703 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0317 23:14:44.408340 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.409485 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.409499 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:44.414660 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.414678 35703 instancegroups.go:431] Draining the node: "node-1b.local". I0317 23:14:44.415067 35703 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0317 23:14:44.415094 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.416235 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.416248 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:44.421405 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.421422 35703 instancegroups.go:431] Draining the node: "node-1c.local". I0317 23:14:44.421812 35703 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0317 23:14:44.421828 35703 instancegroups.go:469] waiting for 1ms after terminating instance I0317 23:14:44.423162 35703 instancegroups.go:504] Validating the cluster. I0317 23:14:44.423175 35703 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0317 23:14:44.428336 35703 instancegroups.go:540] Cluster validated. I0317 23:14:44.428353 35703 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 1.910s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.005s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.011s === RUN TestParse E0317 23:14:42.531497 35706 versions.go:96] unable to parse Kubernetes version "" E0317 23:14:42.531552 35706 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.010s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.038s ? k8s.io/kops/pkg/kopscontrollerclient [no test files] === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.15s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.04s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.209s ? k8s.io/kops/pkg/kubemanifest [no test files] === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.080s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.070s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.067s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I0317 23:14:42.575737 35712 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.057s ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] === RUN Test_RunEtcdManagerBuilder I0317 23:14:42.581978 35713 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W0317 23:14:42.610761 35713 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W0317 23:14:42.611845 35713 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.03s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.095s ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] === RUN Test_RunKubeApiserverBuilder I0317 23:14:42.582164 35714 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.070s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.071s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.027s ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.069s === RUN TestServerGroupBuilder I0317 23:14:42.580903 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.590841 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.599896 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.612858 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.619057 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.633788 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.645089 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.657134 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.920609 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.931482 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.937168 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.944568 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.948901 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.952501 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.956832 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.962776 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.967576 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:42.972236 35719 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.65s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.715s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.029s ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.029s ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.029s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.01s) --- PASS: TestGenerateCertificate/selfsigned (0.00s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (0.93s) --- PASS: TestIssueCert/ca (0.36s) --- PASS: TestIssueCert/client (0.27s) --- PASS: TestIssueCert/clientOneYear (0.30s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 0.944s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.005s ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] === RUN TestAddUntaggedRouteTables I0317 23:14:47.212912 37436 routetable.go:53] DescribeRouteTables: { } I0317 23:14:47.213017 37436 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") W0317 23:14:47.213030 37436 tags.go:67] cluster tag not found on route-table:rtb-1234 --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I0317 23:14:47.213419 37436 iaminstanceprofile.go:193] ListInstanceProfiles: { } W0317 23:14:47.213489 37436 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I0317 23:14:47.213541 37436 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I0317 23:14:47.213592 37436 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I0317 23:14:47.213630 37436 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I0317 23:14:47.213670 37436 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I0317 23:14:47.213723 37436 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I0317 23:14:47.213737 37436 volumes.go:128] DescribeVolumes: { } W0317 23:14:47.213749 37436 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I0317 23:14:47.213829 37436 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:47.213948 37436 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:47.213973 37436 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:47.214012 37436 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:47.214030 37436 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:47.214061 37436 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:47.214082 37436 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:47.214090 37436 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:47.214102 37436 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:47.214116 37436 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:47.214128 37436 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I0317 23:14:47.214146 37436 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I0317 23:14:47.214156 37436 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I0317 23:14:47.214176 37436 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I0317 23:14:47.214187 37436 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I0317 23:14:47.214202 37436 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I0317 23:14:47.214225 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I0317 23:14:47.214246 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I0317 23:14:47.214257 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I0317 23:14:47.214269 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I0317 23:14:47.214280 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I0317 23:14:47.214289 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I0317 23:14:47.214300 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I0317 23:14:47.214308 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I0317 23:14:47.214318 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I0317 23:14:47.214327 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I0317 23:14:47.214337 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I0317 23:14:47.214345 37436 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.050s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.025s ? k8s.io/kops/pkg/resources/digitalocean [no test files] === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.057s ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.005s ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.003s ? k8s.io/kops/pkg/try [no test files] === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.004s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.004s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.004s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.00s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.031s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.076s ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.005s ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] === RUN TestRemovesDuplicateGuardedBlocks W0317 23:14:47.264119 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.264161 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.264165 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.264169 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.264172 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.264175 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.264177 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.264180 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.264183 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.264186 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.264189 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.264191 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.264194 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.264197 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.264200 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.264203 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.280699 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.280732 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.280812 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.280822 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.280880 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.280890 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.280950 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.280964 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281025 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281034 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281100 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281109 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281168 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281177 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281250 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281274 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281338 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281347 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281404 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281414 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281483 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281494 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281565 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281575 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281635 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281645 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281742 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281755 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281816 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281832 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281906 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281917 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.281978 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.281989 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.282051 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.282062 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.282120 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.282130 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.282420 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.282431 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.282494 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.282509 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.282572 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.282584 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.282643 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.282653 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.282714 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.282725 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.282800 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.282812 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.282872 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.282883 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.282942 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.282953 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283015 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283026 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283085 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283096 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283163 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283174 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283233 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283244 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283317 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283328 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283387 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283397 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283467 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283478 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283535 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283545 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283619 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283631 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283703 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283715 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283793 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283806 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283865 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283876 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.283934 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.283944 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284035 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284051 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284112 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284125 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284186 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284197 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284256 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284267 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284327 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284337 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284414 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284425 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284482 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284493 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284571 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284583 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284640 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284650 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284710 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284723 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284783 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284794 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284850 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284860 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284926 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.284937 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.284997 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285007 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285064 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285074 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285134 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285144 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285201 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285211 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285271 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285281 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285339 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285349 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285406 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285417 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285474 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285485 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285547 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285557 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285635 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285656 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285718 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285729 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285787 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285797 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285855 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285866 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285924 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.285935 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.285992 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286003 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.286064 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286075 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.286134 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286144 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.286198 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286207 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.286269 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286280 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.286338 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286349 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.286411 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286423 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.286484 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286497 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.286557 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286568 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.286625 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286636 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.286693 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286704 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.286776 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.286788 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287382 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287390 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287426 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287431 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287465 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287470 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287504 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287510 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287560 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287567 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287600 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287606 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287637 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287643 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287674 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287680 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287712 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287718 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287749 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287755 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287787 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287793 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287823 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287829 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287860 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287865 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287895 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287900 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287930 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287935 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.287967 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.287972 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.288003 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288008 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.288038 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288043 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.288072 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288076 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.288106 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288110 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.02s) === RUN TestRecoversFromBadNesting W0317 23:14:47.288543 37702 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0317 23:14:47.288551 37702 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0317 23:14:47.288555 37702 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0317 23:14:47.288560 37702 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0317 23:14:47.288564 37702 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0317 23:14:47.288567 37702 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0317 23:14:47.288570 37702 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0317 23:14:47.288586 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288591 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288595 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.288599 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288603 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.288608 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288612 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.288615 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288619 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.288622 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288626 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288629 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288632 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288636 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.288639 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.288641 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.472623 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.472658 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.472728 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.472737 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.472792 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.472800 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.472855 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.472864 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.472941 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.472952 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473009 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473025 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473078 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473086 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473143 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473151 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473205 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473212 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473265 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473273 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473335 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473343 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473398 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473406 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473486 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473503 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473568 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473576 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473631 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473639 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473695 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473703 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473757 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473767 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473821 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473829 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473882 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473891 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.473944 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.473952 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474009 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474017 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474071 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474083 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474139 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474149 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474205 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474214 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474269 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474278 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474332 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474341 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474397 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474406 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474458 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474467 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474543 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474553 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474608 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474617 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474670 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474679 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474736 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474745 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474801 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474812 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474868 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474877 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474932 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.474941 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.474996 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475005 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475059 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475068 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475121 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475130 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475196 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475209 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475267 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475275 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475327 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475334 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475404 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475412 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475469 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475477 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475530 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475537 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475592 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475600 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475652 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475659 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475718 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475726 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475779 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475792 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475843 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475850 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475900 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475908 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.475961 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.475968 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476061 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476070 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476137 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476146 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476197 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476205 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476256 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476264 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476316 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476324 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476378 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476385 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476435 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476443 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476494 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476501 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476551 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476558 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476612 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476619 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476666 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476673 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476723 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476730 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476802 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476809 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476861 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476867 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476915 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476921 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.476970 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.476977 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477027 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477033 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477086 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477094 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477143 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477150 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477201 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477208 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477260 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477267 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477326 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477334 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477389 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477396 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477448 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477456 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477510 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477517 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477586 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477593 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477647 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477655 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477707 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477717 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477770 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477777 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477829 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477837 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477892 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477898 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.477950 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.477959 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478021 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478028 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478085 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478092 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478143 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478150 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478204 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478212 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478265 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478273 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478326 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478334 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478385 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478392 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478444 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478451 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478504 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478511 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478562 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478569 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478618 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478626 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478685 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478694 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478748 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478755 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478806 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478813 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478861 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478869 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0317 23:14:47.478924 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0317 23:14:47.478932 37702 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.19s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.222s ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.00s) PASS ok k8s.io/kops/tests/codecs 0.027s ? k8s.io/kops/tests/fuzz [no test files] === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.00s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.00s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.054s ? k8s.io/kops/tests/integration/channel/simple [no test files] === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.01s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.01s) PASS ok k8s.io/kops/tests/integration/conversion 0.027s ? k8s.io/kops/upup/models [no test files] === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I0317 23:14:49.701660 39712 files.go:57] Writing file "/tmp/TestWriteFile2283933481/001/SubDir/test1.tmp" I0317 23:14:49.701860 39712 files.go:113] Changing file mode for "/tmp/TestWriteFile2283933481/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.025s === RUN TestBootstrapChannelBuilder_BuildTasks I0317 23:14:53.758369 40027 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:53.758530 40027 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:53.758556 40027 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:53.758586 40027 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:53.758604 40027 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:53.758639 40027 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:53.758666 40027 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:53.758679 40027 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:53.758701 40027 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:53.758721 40027 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:53.763340 40027 zones.go:93] ListHostedZonesPages { } I0317 23:14:53.818140 40027 zones.go:93] ListHostedZonesPages { } I0317 23:14:53.884986 40027 zones.go:93] ListHostedZonesPages { } I0317 23:14:53.959771 40027 zones.go:93] ListHostedZonesPages { } I0317 23:14:54.024679 40027 zones.go:93] ListHostedZonesPages { } I0317 23:14:54.090171 40027 zones.go:93] ListHostedZonesPages { } I0317 23:14:54.151788 40027 zones.go:93] ListHostedZonesPages { } I0317 23:14:54.223826 40027 zones.go:93] ListHostedZonesPages { } I0317 23:14:54.602197 40027 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (0.95s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I0317 23:14:54.706509 40027 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:54.706690 40027 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:54.706776 40027 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:54.706817 40027 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:54.706851 40027 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:54.706886 40027 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:54.706916 40027 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:54.706935 40027 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:54.706961 40027 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:54.706992 40027 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:54.707013 40027 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I0317 23:14:54.708299 40027 zones.go:93] ListHostedZonesPages { } I0317 23:14:54.863015 40027 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.16s) === RUN TestBootstrapChannelBuilder_AWSCloudController I0317 23:14:54.863215 40027 featureflag.go:164] FeatureFlag "ImageDigest"=false I0317 23:14:54.863388 40027 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:54.863455 40027 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0317 23:14:54.863494 40027 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0317 23:14:54.863525 40027 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0317 23:14:54.863558 40027 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0317 23:14:54.863585 40027 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0317 23:14:54.863606 40027 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0317 23:14:54.863632 40027 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0317 23:14:54.863650 40027 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0317 23:14:54.865145 40027 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.11s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.82s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W0317 23:14:55.814930 40027 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I0317 23:14:55.859362 40027 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I0317 23:14:55.859445 40027 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I0317 23:14:55.859458 40027 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I0317 23:14:55.859531 40027 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I0317 23:14:55.859548 40027 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I0317 23:14:55.859614 40027 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I0317 23:14:55.859684 40027 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I0317 23:14:55.859756 40027 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0317 23:14:55.859776 40027 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I0317 23:14:55.859852 40027 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0317 23:14:55.859871 40027 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I0317 23:14:55.859995 40027 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I0317 23:14:55.860131 40027 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I0317 23:14:55.860214 40027 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I0317 23:14:55.860229 40027 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I0317 23:14:55.860237 40027 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I0317 23:14:55.860254 40027 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I0317 23:14:55.860268 40027 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I0317 23:14:55.860275 40027 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I0317 23:14:55.860282 40027 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I0317 23:14:55.860290 40027 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I0317 23:14:55.861717 40027 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I0317 23:14:55.861957 40027 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.187s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I0317 23:14:53.749472 40029 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2309788154/001 I0317 23:14:53.749729 40029 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2309788154/001 I0317 23:14:53.749949 40029 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2309788154/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I0317 23:14:53.752574 40029 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0317 23:14:53.752642 40029 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0317 23:14:53.752681 40029 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I0317 23:14:53.752747 40029 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0317 23:14:53.752820 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.752860 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.752871 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.752965 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:14:53.752992 40029 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0317 23:14:53.753010 40029 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0317 23:14:53.753052 40029 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0317 23:14:53.753101 40029 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0317 23:14:53.753136 40029 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0317 23:14:53.753165 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.753186 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.753193 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.753210 40029 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0317 23:14:53.753230 40029 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0317 23:14:53.753257 40029 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I0317 23:14:53.753333 40029 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0317 23:14:53.753360 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.753406 40029 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0317 23:14:53.753454 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:14:53.753467 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.753479 40029 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0317 23:14:53.753529 40029 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0317 23:14:53.753618 40029 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0317 23:14:53.753648 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:14:53.753660 40029 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:14:53.753673 40029 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0317 23:14:53.753713 40029 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:14:53.753785 40029 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I0317 23:14:53.753814 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:14:53.753825 40029 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I0317 23:14:53.753843 40029 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0317 23:14:53.753881 40029 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0317 23:14:53.753903 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.753925 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.753932 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.753944 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.753956 40029 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0317 23:14:53.753975 40029 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0317 23:14:53.754002 40029 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:14:53.754014 40029 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0317 23:14:53.754034 40029 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:14:53.754064 40029 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I0317 23:14:53.754082 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0317 23:14:53.754101 40029 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I0317 23:14:53.754133 40029 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0317 23:14:53.754150 40029 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0317 23:14:53.754161 40029 internetgateways.go:66] CreateInternetGateway: { } I0317 23:14:53.754171 40029 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I0317 23:14:53.754203 40029 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0317 23:14:53.754223 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.754244 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.754251 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.754284 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:14:53.754296 40029 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0317 23:14:53.754311 40029 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0317 23:14:53.754342 40029 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0317 23:14:53.754383 40029 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0317 23:14:53.754410 40029 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0317 23:14:53.754429 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.754449 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.754458 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.754482 40029 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0317 23:14:53.754503 40029 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0317 23:14:53.754531 40029 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I0317 23:14:53.754843 40029 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender1970343436/001 I0317 23:14:53.755050 40029 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender1970343436/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I0317 23:14:53.755326 40029 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0317 23:14:53.755351 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.755396 40029 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0317 23:14:53.755421 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:14:53.755432 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.755446 40029 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0317 23:14:53.755502 40029 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0317 23:14:53.755616 40029 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I0317 23:14:53.755643 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0317 23:14:53.755660 40029 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0317 23:14:53.755689 40029 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0317 23:14:53.755716 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.755746 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.755754 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.755766 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.755779 40029 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0317 23:14:53.755800 40029 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0317 23:14:53.755834 40029 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I0317 23:14:53.755950 40029 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0317 23:14:53.755972 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.756028 40029 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0317 23:14:53.756046 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:14:53.756056 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.756068 40029 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0317 23:14:53.756089 40029 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0317 23:14:53.756132 40029 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0317 23:14:53.756153 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:14:53.756163 40029 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:14:53.756175 40029 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0317 23:14:53.756209 40029 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0317 23:14:53.756229 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.756250 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.756257 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.756268 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.756280 40029 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0317 23:14:53.756299 40029 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0317 23:14:53.756324 40029 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:14:53.756337 40029 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I0317 23:14:53.756404 40029 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0317 23:14:53.756425 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.756474 40029 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0317 23:14:53.756492 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:14:53.756503 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.756515 40029 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0317 23:14:53.756539 40029 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0317 23:14:53.756585 40029 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0317 23:14:53.756626 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:14:53.756641 40029 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:14:53.756665 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.756828 40029 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0317 23:14:53.756869 40029 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0317 23:14:53.756945 40029 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0317 23:14:53.756990 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.757032 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.757047 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.757072 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.757094 40029 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0317 23:14:53.757145 40029 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0317 23:14:53.757210 40029 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:14:53.757226 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.757260 40029 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I0317 23:14:53.757364 40029 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0317 23:14:53.757405 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.757478 40029 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0317 23:14:53.757514 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:14:53.757535 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.757557 40029 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0317 23:14:53.757615 40029 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0317 23:14:53.757778 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.757812 40029 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0317 23:14:53.757884 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:14:53.757908 40029 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:14:53.757923 40029 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0317 23:14:53.757943 40029 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0317 23:14:53.758008 40029 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0317 23:14:53.758037 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.758066 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.758074 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.758089 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.758103 40029 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0317 23:14:53.758126 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.758152 40029 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0317 23:14:53.758211 40029 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:14:53.758229 40029 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I0317 23:14:53.758298 40029 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I0317 23:14:53.758337 40029 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I0317 23:14:53.758376 40029 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0317 23:14:53.758399 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.758418 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.758426 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.758464 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:14:53.758478 40029 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0317 23:14:53.758495 40029 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0317 23:14:53.758515 40029 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:14:53.758571 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0317 23:14:53.758584 40029 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0317 23:14:53.758600 40029 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0317 23:14:53.758648 40029 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0317 23:14:53.758671 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.758691 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.758707 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.758726 40029 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0317 23:14:53.758756 40029 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0317 23:14:53.758786 40029 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I0317 23:14:53.758840 40029 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.758861 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.758909 40029 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0317 23:14:53.758927 40029 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0317 23:14:53.758938 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.758949 40029 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0317 23:14:53.758968 40029 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.758996 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0317 23:14:53.759024 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.759031 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.759043 40029 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0317 23:14:53.759056 40029 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I0317 23:14:53.759134 40029 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I0317 23:14:53.759173 40029 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.759196 40029 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I0317 23:14:53.759217 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0317 23:14:53.759234 40029 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0317 23:14:53.759250 40029 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.056s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.045s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.027s === RUN TestDiskRenderAzure I0317 23:14:53.732506 40031 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I0317 23:14:53.732799 40031 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I0317 23:14:53.732967 40031 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I0317 23:14:53.733334 40031 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I0317 23:14:53.733485 40031 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I0317 23:14:53.733664 40031 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I0317 23:14:53.733858 40031 resourcegroup.go:108] Creating a new Resource Group with name: rg I0317 23:14:53.733867 40031 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I0317 23:14:53.733994 40031 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I0317 23:14:53.734275 40031 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I0317 23:14:53.734395 40031 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I0317 23:14:53.734500 40031 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I0317 23:14:53.734659 40031 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I0317 23:14:53.734848 40031 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.031s ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.025s ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] === RUN TestProjectIAMBinding I0317 23:14:53.748613 40032 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.748966 40032 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0317 23:14:53.748980 40032 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.749224 40032 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0317 23:14:53.749239 40032 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.749323 40032 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I0317 23:14:53.749387 40032 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.749434 40032 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0317 23:14:53.749445 40032 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.749503 40032 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0317 23:14:53.749515 40032 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.749537 40032 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I0317 23:14:53.749588 40032 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.749728 40032 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0317 23:14:53.749759 40032 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.749933 40032 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0317 23:14:53.749947 40032 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0317 23:14:53.750012 40032 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.045s ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.049s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.038s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.027s ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.029s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.010s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.025s ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I0317 23:14:53.761955 40040 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I0317 23:14:53.762016 40040 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I0317 23:14:53.762023 40040 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I0317 23:14:53.762032 40040 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I0317 23:14:53.762039 40040 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I0317 23:14:53.762045 40040 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I0317 23:14:53.762050 40040 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W0317 23:14:53.762368 40040 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.058s ? k8s.io/kops/upup/pkg/fi/secrets [no test files] === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.006s ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.006s ? k8s.io/kops/util/pkg/env [no test files] === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.006s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.007s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.006s ? k8s.io/kops/util/pkg/mirrors [no test files] === RUN TestGetProxyEnvVars W0317 23:14:53.733582 40047 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.026s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.029s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.005s ? k8s.io/kops/util/pkg/tables [no test files] === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.007s ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.022s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W0317 23:14:57.288852 40514 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.054s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... kubernetes >>> kops*: Package size: 146.3 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.4-r8.apk >>> kops: Build complete at Mon, 17 Mar 2025 23:17:45 +0000 elapsed time 0h 4m 53s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/4) Purging .makedepends-kops (20250317.231253) (2/4) Purging kubernetes (1.32.2-r1) (3/4) Purging go (1.24.1-r0) (4/4) Purging bash (5.2.37-r0) Executing bash-5.2.37-r0.pre-deinstall Executing busybox-1.37.0-r14.trigger OK: 399 MiB in 107 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...