>>> kops: Building testing/kops 1.28.4-r3 (using abuild 3.13.0-r3) started Sat, 18 May 2024 19:52:10 +0000 >>> kops: Checking sanity of /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/5) Installing kubernetes (1.30.0-r1) (2/5) Installing go (1.22.3-r0) (3/5) Installing readline (8.2.10-r0) (4/5) Installing bash (5.2.26-r0) Executing bash-5.2.26-r0.post-install (5/5) Installing .makedepends-kops (20240518.195213) Executing busybox-1.36.1-r26.trigger OK: 562 MiB in 112 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 85 32.7M 85 28.1M 0 0 40.2M 0 --:--:-- --:--:-- --:--:-- 40.2M 100 32.7M 100 32.7M 0 0 43.9M 0 --:--:-- --:--:-- --:--:-- 43.9M >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz >>> kops: Checking sha512sums... kops-1.28.4.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.4.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.4 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/spf13/pflag v1.0.5 go: downloading go.uber.org/multierr v1.11.0 go: downloading golang.org/x/crypto v0.14.0 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading k8s.io/api v0.28.1 go: downloading k8s.io/apimachinery v0.28.1 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading k8s.io/client-go v0.28.1 go: downloading github.com/spf13/cobra v1.7.0 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading k8s.io/kubectl v0.28.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading k8s.io/klog v1.0.0 go: downloading golang.org/x/net v0.17.0 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading google.golang.org/api v0.138.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/google/uuid v1.3.1 go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/pkg/errors v0.9.1 go: downloading golang.org/x/sys v0.13.0 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading golang.org/x/term v0.13.0 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/kr/fs v0.1.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading golang.org/x/text v0.13.0 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading google.golang.org/protobuf v1.31.0 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/google/btree v1.0.1 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/s2a-go v0.1.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/docker/go-metrics v0.0.1 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/moby/locker v1.0.1 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/oklog/ulid v1.3.1 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I0518 19:55:14.337346 53942 addon.go:250] addon test wants to update all nodes I0518 19:55:14.339985 53942 addon.go:250] addon test wants to update workers nodes I0518 19:55:14.340496 53942 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I0518 19:55:14.341120 53942 addon.go:283] installing PKI for "test" I0518 19:55:14.606086 53942 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.67s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.737s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.058s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] ? k8s.io/kops/pkg/apis/kops/registry [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] ? k8s.io/kops/pkg/commands/commandutils [no test files] ? k8s.io/kops/pkg/configserver [no test files] ? k8s.io/kops/pkg/dump [no test files] ? k8s.io/kops/pkg/kopscontrollerclient [no test files] ? k8s.io/kops/pkg/kubemanifest [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] ? k8s.io/kops/pkg/resources/digitalocean [no test files] ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] ? k8s.io/kops/pkg/try [no test files] ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] ? k8s.io/kops/tests/fuzz [no test files] ? k8s.io/kops/tests/integration/channel/simple [no test files] ? k8s.io/kops/upup/models [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/secrets [no test files] ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] ? k8s.io/kops/util/pkg/env [no test files] ? k8s.io/kops/util/pkg/mirrors [no test files] ? k8s.io/kops/util/pkg/tables [no test files] ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestCreateClusterMinimal I0518 19:55:16.554755 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:16.554999 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:16.555058 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:16.555112 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:16.555178 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:16.555262 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:16.555322 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:16.555357 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:16.555416 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:16.555484 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:16.565833 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:16.565926 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:16.650094 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:16.650339 55086 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0518 19:55:16.650729 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:16.669439 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:16.669522 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:16.669551 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:16.669580 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:16.669603 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:16.669637 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:16.669663 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:16.669680 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:16.669703 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:16.669720 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:16.673201 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:16.673246 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:16.748593 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:16.748766 55086 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0518 19:55:16.749052 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:16.754411 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:16.754535 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:16.754567 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:16.754616 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:16.754657 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:16.754711 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:16.754753 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:16.754785 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:16.754827 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:16.754856 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:16.758839 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:16.758917 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:16.817854 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:16.818026 55086 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0518 19:55:16.818369 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:16.823903 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:16.823972 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:16.823998 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:16.824031 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:16.824057 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:16.824089 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:16.824117 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:16.824135 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:16.824159 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:16.824177 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:16.828045 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:16.828092 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:16.858669 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:16.858835 55086 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0518 19:55:16.859137 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:16.907880 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:16.908023 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:16.908061 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:16.908099 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:16.908126 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:16.908162 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:16.908194 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:16.908211 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:16.908237 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:16.908254 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:16.912063 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:16.912115 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:17.001966 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:17.002217 55086 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0518 19:55:17.002597 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:17.010582 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:17.010680 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:17.010714 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:17.010755 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:17.010789 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:17.010831 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:17.010871 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:17.010901 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:17.010936 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:17.010959 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:17.619900 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:17.619979 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:17.670475 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:17.670584 55086 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0518 19:55:17.670905 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:17.680254 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:17.680373 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:17.680417 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:17.680465 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:17.680507 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:17.680566 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:17.680610 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:17.680642 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:17.680683 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:17.680714 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:17.687292 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:17.687359 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:17.824538 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:17.824714 55086 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0518 19:55:17.825039 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (1.28s) === RUN TestCreateClusterHetzner I0518 19:55:17.830739 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:17.830853 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:17.830880 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:17.830912 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:17.830938 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:17.830968 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:17.830995 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:17.831011 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:17.831051 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:17.831071 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:17.844975 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:17.845053 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0518 19:55:17.926068 55086 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0518 19:55:17.926132 55086 new_cluster.go:1373] Cloud Provider ID: "hetzner" I0518 19:55:17.936375 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:17.936479 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:17.936515 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:17.936554 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:17.936588 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:17.936634 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:17.936672 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:17.936700 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:17.936735 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:17.936759 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:17.953203 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:17.953288 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.063734 55086 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.24s) === RUN TestCreateClusterOpenStack I0518 19:55:18.069063 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:18.069151 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:18.069180 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:18.069210 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:18.069234 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:18.069268 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:18.069295 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:18.069317 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:18.069356 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:18.069376 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:18.075575 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.075641 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0518 19:55:18.154736 55086 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0518 19:55:18.154868 55086 new_cluster.go:1373] Cloud Provider ID: "openstack" I0518 19:55:18.157765 55086 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.10s) === RUN TestCreateClusterOpenStackOctavia I0518 19:55:18.170345 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:18.170512 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:18.170589 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:18.170676 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:18.170754 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:18.170844 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:18.170926 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:18.170997 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:18.171082 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:18.171151 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:18.176435 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.176532 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0518 19:55:18.262429 55086 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0518 19:55:18.262492 55086 new_cluster.go:1373] Cloud Provider ID: "openstack" I0518 19:55:18.264574 55086 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0518 19:55:18.264601 55086 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.10s) === RUN TestCreateClusterOpenStackNoDNS I0518 19:55:18.273129 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:18.273215 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:18.273246 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:18.273279 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:18.273305 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:18.273336 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:18.273365 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:18.273384 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:18.273408 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:18.273425 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:18.277010 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.277069 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0518 19:55:18.392763 55086 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0518 19:55:18.393051 55086 new_cluster.go:1373] Cloud Provider ID: "openstack" I0518 19:55:18.393130 55086 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0518 19:55:18.393164 55086 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.14s) === RUN TestCreateClusterCilium I0518 19:55:18.408613 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:18.408701 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:18.408733 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:18.408766 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:18.408791 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:18.408828 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:18.408857 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:18.408877 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:18.408901 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:18.408919 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:18.412884 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.412930 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.516481 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:18.516696 55086 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0518 19:55:18.517073 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.11s) === RUN TestCreateClusterOverride I0518 19:55:18.522983 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:18.523073 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:18.523101 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:18.523132 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:18.523155 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:18.523187 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:18.523215 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:18.523232 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:18.523255 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:18.523274 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:18.594669 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.594826 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.647077 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:18.647580 55086 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0518 19:55:18.647888 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.13s) === RUN TestCreateClusterKubernetesFeatureGates I0518 19:55:18.653614 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:18.653709 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:18.653744 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:18.653776 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:18.653800 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:18.653840 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:18.653869 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:18.653887 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:18.653913 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:18.653932 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:18.660363 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.660418 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.699868 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:18.700055 55086 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0518 19:55:18.700529 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.06s) === RUN TestCreateClusterComplex I0518 19:55:18.709189 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:18.709291 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:18.709322 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:18.709356 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:18.709380 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:18.709415 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:18.709443 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:18.709460 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:18.709484 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:18.709503 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:18.713408 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.713457 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.883695 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:18.884227 55086 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I0518 19:55:18.884247 55086 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I0518 19:55:18.884262 55086 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I0518 19:55:18.884785 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.19s) === RUN TestCreateClusterComplexPrivate I0518 19:55:18.895576 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:18.895694 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:18.895734 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:18.895779 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:18.895814 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:18.895860 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:18.895897 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:18.895923 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:18.895960 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:18.895986 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:18.907160 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.907220 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:18.990032 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:18.990791 55086 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I0518 19:55:18.990820 55086 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I0518 19:55:18.990840 55086 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I0518 19:55:18.990858 55086 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I0518 19:55:18.990874 55086 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I0518 19:55:18.990888 55086 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I0518 19:55:18.990905 55086 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I0518 19:55:18.990928 55086 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I0518 19:55:18.990949 55086 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I0518 19:55:18.990961 55086 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I0518 19:55:18.991713 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.12s) === RUN TestCreateClusterHA I0518 19:55:19.012073 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:19.012209 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:19.012259 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:19.012316 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:19.012359 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:19.012414 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:19.012465 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:19.012499 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:19.012546 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:19.012578 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:19.022854 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.022938 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.109338 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:19.109683 55086 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0518 19:55:19.109698 55086 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0518 19:55:19.109708 55086 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0518 19:55:19.110050 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:19.118906 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:19.118985 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:19.119015 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:19.119047 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:19.119073 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:19.119108 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:19.119137 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:19.119170 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:19.119201 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:19.119222 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:19.123025 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.123069 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.166380 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:19.166700 55086 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0518 19:55:19.166716 55086 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0518 19:55:19.166727 55086 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0518 19:55:19.167065 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.17s) === RUN TestCreateClusterMinimalGCE I0518 19:55:19.179008 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:19.179102 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:19.179130 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:19.179162 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:19.179186 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:19.179217 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:19.179244 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:19.179261 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:19.179284 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:19.179302 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:19.182964 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.183005 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.222270 55086 new_cluster.go:1373] Cloud Provider ID: "gce" I0518 19:55:19.222399 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I0518 19:55:19.227811 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:19.227883 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:19.227911 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:19.227940 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:19.227964 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:19.227993 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:19.228018 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:19.228037 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:19.228060 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:19.228078 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:19.231460 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.231506 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.303385 55086 new_cluster.go:1373] Cloud Provider ID: "gce" I0518 19:55:19.303510 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.14s) === RUN TestCreateClusterHAGCE I0518 19:55:19.318534 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:19.318652 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:19.318688 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:19.318728 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:19.318762 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:19.318804 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:19.318839 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:19.318866 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:19.318901 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:19.318924 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:19.324371 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.324466 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.382268 55086 new_cluster.go:1373] Cloud Provider ID: "gce" I0518 19:55:19.382461 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.08s) === RUN TestCreateClusterGCE I0518 19:55:19.396664 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:19.396959 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:19.397391 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:19.397514 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:19.397575 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:19.397626 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:19.397724 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:19.397761 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:19.397811 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:19.397838 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:19.402994 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.403051 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.454544 55086 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0518 19:55:19.454648 55086 new_cluster.go:1373] Cloud Provider ID: "gce" I0518 19:55:19.454756 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.07s) === RUN TestCreateClusterHASharedZone I0518 19:55:19.463008 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:19.463126 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:19.463164 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:19.463204 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:19.463240 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:19.463284 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:19.463322 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:19.463351 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:19.463388 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:19.463414 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:19.467532 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.467598 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0518 19:55:19.572342 55086 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0518 19:55:19.572410 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:19.572854 55086 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0518 19:55:19.573293 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.12s) === RUN TestCreateClusterHASharedZones I0518 19:55:19.588034 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:19.588147 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:19.588180 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:19.588222 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:19.588256 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:19.588299 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:19.588339 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:19.588365 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:19.588401 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:19.588425 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:19.594175 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.594233 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0518 19:55:19.634656 55086 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0518 19:55:19.634712 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:19.635059 55086 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I0518 19:55:19.635074 55086 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I0518 19:55:19.635426 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.06s) === RUN TestCreateClusterPrivate I0518 19:55:19.645756 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:19.645864 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:19.645898 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:19.645929 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:19.645964 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:19.646000 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:19.646034 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:19.646054 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:19.646077 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:19.646096 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:19.650394 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.650436 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.686649 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:19.686877 55086 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0518 19:55:19.686898 55086 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0518 19:55:19.687227 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:19.687272 55086 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.05s) === RUN TestCreateClusterPrivateGCE I0518 19:55:19.693943 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:19.694029 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:19.694055 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:19.694086 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:19.694113 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:19.694144 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:19.694175 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:19.694193 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:19.694216 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:19.694235 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:19.697851 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.697895 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.901953 55086 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0518 19:55:19.902039 55086 new_cluster.go:1373] Cloud Provider ID: "gce" I0518 19:55:19.902148 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.22s) === RUN TestCreateClusterWithNGWSpecified I0518 19:55:19.909023 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:19.909122 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:19.909152 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:19.909183 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:19.909208 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:19.909241 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:19.909270 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:19.909286 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:19.909310 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:19.909329 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:19.912972 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.913023 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:19.990906 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:19.991268 55086 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0518 19:55:19.991301 55086 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0518 19:55:19.991758 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:19.991804 55086 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.10s) === RUN TestCreateClusterWithINGWSpecified I0518 19:55:20.005557 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:20.005681 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:20.005721 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:20.005765 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:20.005803 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:20.005851 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:20.005894 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:20.005926 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:20.005965 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:20.005994 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:20.017821 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.017891 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.123178 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:20.123540 55086 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0518 19:55:20.123571 55086 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0518 19:55:20.124059 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:20.124105 55086 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.13s) === RUN TestCreateClusterSharedVPC I0518 19:55:20.134349 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:20.134517 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:20.134556 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:20.134604 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:20.134642 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:20.134687 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:20.134729 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:20.134760 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:20.134798 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:20.134825 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:20.138811 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.138863 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.180558 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:20.180829 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.180905 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.181105 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.181144 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.181210 55086 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I0518 19:55:20.181697 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.06s) === RUN TestCreateClusterSharedSubnets I0518 19:55:20.190624 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:20.190752 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:20.190790 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:20.190834 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:20.190872 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:20.190919 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:20.190958 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:20.190987 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:20.191034 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:20.191064 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:20.195383 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.195422 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.226248 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.226319 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.226445 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:20.226668 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.226697 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.226733 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.226756 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.227190 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.05s) === RUN TestCreateClusterSharedSubnetsVpcLookup I0518 19:55:20.235908 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:20.236025 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:20.236057 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:20.236094 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:20.236130 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:20.236176 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:20.236217 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:20.236246 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:20.236281 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:20.236306 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:20.244876 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.244939 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.316893 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:55:20.316963 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.316990 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.317089 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:20.317251 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.317277 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.317305 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.317323 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.317705 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.09s) === RUN TestCreateClusterPrivateSharedSubnets I0518 19:55:20.324122 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:20.324229 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:20.324259 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:20.324292 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:20.324319 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:20.324370 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:20.324407 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:20.324427 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:20.324457 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:20.324478 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:20.328852 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.328914 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.376206 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.376266 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.376328 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.376348 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.376427 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:20.376612 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.376647 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.376668 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:55:20.376701 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:55:20.377118 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.06s) === RUN TestCreateClusterIPv6 I0518 19:55:20.386400 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:20.386493 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:20.386522 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:20.386553 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:20.386577 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:20.386611 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:20.386639 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:20.386657 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:20.386681 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:20.386700 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:20.391293 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.391344 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.422084 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:20.422265 55086 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I0518 19:55:20.422285 55086 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I0518 19:55:20.422795 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.04s) === RUN TestCreateClusterDifferentAMIs I0518 19:55:20.429889 55086 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0518 19:55:20.429912 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:20.430025 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:20.430065 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:20.430113 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:20.430149 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:20.430193 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:20.430236 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:20.430264 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:20.430301 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:20.430329 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:20.434571 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.434615 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.498581 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:20.498689 55086 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0518 19:55:20.498715 55086 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0518 19:55:20.499122 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:20.513329 55086 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.08s) === RUN TestCreateClusterKarpenter I0518 19:55:20.513440 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:20.513551 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:20.513586 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:20.513626 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:20.513659 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:20.513701 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:20.513736 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:20.513764 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:20.513799 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:20.513824 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:20.521764 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.521888 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0518 19:55:20.571924 55086 new_cluster.go:1373] Cloud Provider ID: "aws" I0518 19:55:20.572216 55086 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0518 19:55:20.572245 55086 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0518 19:55:20.572266 55086 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0518 19:55:20.572775 55086 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.07s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I0518 19:55:20.579630 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:20.579707 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:20.579733 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:20.579784 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:20.579810 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:20.579841 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:20.579865 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:20.579882 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:20.579906 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:20.579923 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:20.585220 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.01s) === RUN TestMinimal I0518 19:55:20.586359 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:20.586427 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:20.586448 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:20.586473 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:20.586495 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:20.586521 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:20.586543 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:20.586559 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:20.586579 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:20.586595 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:20.602504 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0518 19:55:20.604313 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:20.604391 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0518 19:55:26.134688 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:29.278167 55086 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0518 19:55:29.279698 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:55:29.279722 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:55:29.279789 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:55:29.282275 55086 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0518 19:55:29.285808 55086 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0518 19:55:29.286808 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:29.287071 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:29.287247 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:29.287503 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:29.287582 55086 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0518 19:55:29.287998 55086 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0518 19:55:29.288362 55086 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0518 19:55:29.291370 55086 target.go:111] Terraform output is in /tmp/test2753275801/out --- PASS: TestMinimal (8.71s) === RUN TestMinimal_v1_23 I0518 19:55:29.296226 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:29.296379 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:29.296412 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:29.296446 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:29.296473 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:29.296504 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:29.296535 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:29.296551 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:29.296574 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:29.296591 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:29.314432 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0518 19:55:29.317306 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:29.317387 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:31.445829 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:31.565384 55086 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0518 19:55:31.567100 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:55:31.567123 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:55:31.567185 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:55:31.568807 55086 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0518 19:55:31.572103 55086 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0518 19:55:31.572339 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:31.572508 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:31.572743 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:31.572796 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:31.572843 55086 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0518 19:55:31.573020 55086 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0518 19:55:31.573232 55086 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0518 19:55:31.576399 55086 target.go:111] Terraform output is in /tmp/test3850298416/out --- PASS: TestMinimal_v1_23 (2.28s) === RUN TestMinimal_v1_24 I0518 19:55:31.580477 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:31.580630 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:31.580697 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:31.580763 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:31.580921 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:31.581041 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:31.581112 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:31.581144 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:31.581196 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:31.581232 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:31.597115 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:55:31.599126 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:31.599193 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:33.696969 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:33.902707 55086 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0518 19:55:33.903553 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:55:33.903588 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:55:33.903667 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:55:33.906045 55086 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0518 19:55:33.918710 55086 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0518 19:55:33.919347 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:33.919752 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:33.920564 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:33.921139 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:33.921745 55086 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0518 19:55:33.922087 55086 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0518 19:55:33.949002 55086 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0518 19:55:33.954470 55086 target.go:111] Terraform output is in /tmp/test1541221871/out --- PASS: TestMinimal_v1_24 (2.38s) === RUN TestMinimal_v1_25 I0518 19:55:33.958177 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:33.958316 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:33.958357 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:33.958407 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:33.958445 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:33.958491 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:33.958531 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:33.958560 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:33.958597 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:33.958622 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:33.998001 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0518 19:55:34.001126 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:34.001209 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:36.032000 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:36.215572 55086 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0518 19:55:36.217189 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:55:36.217238 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:55:36.217347 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:55:36.221165 55086 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0518 19:55:36.224598 55086 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0518 19:55:36.224843 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:36.225016 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:36.225310 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:36.225704 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:36.225807 55086 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0518 19:55:36.226086 55086 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0518 19:55:36.226351 55086 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0518 19:55:36.229610 55086 target.go:111] Terraform output is in /tmp/test3735954136/out --- PASS: TestMinimal_v1_25 (2.27s) === RUN TestMinimal_v1_26 I0518 19:55:36.232303 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:36.232386 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:36.232418 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:36.232449 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:36.232474 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:36.232506 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:36.232531 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:36.232547 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:36.232573 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:36.232590 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:36.247829 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0518 19:55:36.249796 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:36.249862 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:38.559858 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:38.757515 55086 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0518 19:55:38.757814 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:55:38.757845 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:55:38.757932 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:55:38.765472 55086 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0518 19:55:38.771004 55086 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0518 19:55:38.772232 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:38.772700 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:38.773202 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:38.773848 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:38.774772 55086 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0518 19:55:38.775169 55086 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0518 19:55:38.778838 55086 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0518 19:55:38.789035 55086 target.go:111] Terraform output is in /tmp/test981297008/out --- PASS: TestMinimal_v1_26 (2.56s) === RUN TestMinimal_v1_27 I0518 19:55:38.793751 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:38.793905 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:38.793951 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:38.794001 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:38.794045 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:38.794097 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:38.794144 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:38.794176 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:38.794223 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:38.794255 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:38.814636 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0518 19:55:38.818552 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:38.818626 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:41.871629 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:42.034482 55086 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0518 19:55:42.034848 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:55:42.034876 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:55:42.034956 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:55:42.037365 55086 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0518 19:55:42.040992 55086 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0518 19:55:42.041232 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:42.041429 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:42.041683 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:42.041814 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:42.041884 55086 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0518 19:55:42.042080 55086 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0518 19:55:42.042304 55086 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0518 19:55:42.049351 55086 target.go:111] Terraform output is in /tmp/test2983778094/out --- PASS: TestMinimal_v1_27 (3.26s) === RUN TestMinimal_NoneDNS I0518 19:55:42.053519 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:42.053640 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:42.053686 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:42.053736 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:42.053778 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:42.053829 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:42.053873 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:42.053905 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:42.053946 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:42.053974 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0518 19:55:42.083112 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:42.083213 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:43.475869 55086 executor.go:111] Tasks: 0 done / 110 total; 43 can run I0518 19:55:43.478207 55086 executor.go:111] Tasks: 43 done / 110 total; 24 can run I0518 19:55:43.479998 55086 executor.go:111] Tasks: 67 done / 110 total; 29 can run I0518 19:55:43.480455 55086 executor.go:111] Tasks: 96 done / 110 total; 2 can run I0518 19:55:43.480504 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:55:43.480565 55086 loadbalancers.go:35] PageSize not implemented I0518 19:55:43.480653 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:55:43.480722 55086 loadbalancers.go:35] PageSize not implemented I0518 19:55:43.483982 55086 executor.go:111] Tasks: 98 done / 110 total; 4 can run I0518 19:55:43.484202 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:43.484388 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:43.484809 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:43.484907 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:43.485017 55086 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0518 19:55:43.485249 55086 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0518 19:55:43.485447 55086 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0518 19:55:43.489919 55086 target.go:111] Terraform output is in /tmp/test2095150516/out --- PASS: TestMinimal_NoneDNS (1.46s) === RUN TestHetzner I0518 19:55:43.509377 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:55:45.540827 55086 executor.go:111] Tasks: 0 done / 46 total; 37 can run I0518 19:55:45.542929 55086 executor.go:111] Tasks: 37 done / 46 total; 3 can run I0518 19:55:45.543192 55086 executor.go:111] Tasks: 40 done / 46 total; 2 can run I0518 19:55:45.546214 55086 executor.go:111] Tasks: 42 done / 46 total; 4 can run I0518 19:55:45.546718 55086 executor.go:111] Tasks: 46 done / 46 total; 0 can run I0518 19:55:45.548075 55086 target.go:111] Terraform output is in /tmp/test2683532061/out --- PASS: TestHetzner (2.04s) === RUN TestNvidia I0518 19:55:45.551932 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:45.552032 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:45.552066 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:45.552102 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:45.552129 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:45.552163 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:45.552193 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:45.552210 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:45.552235 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:45.552254 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:45.566457 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:55:45.568356 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:45.568435 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:47.521376 55086 zones.go:93] ListHostedZonesPages { } I0518 19:55:47.651993 55086 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0518 19:55:47.654298 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:55:47.654343 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:55:47.654436 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:55:47.656131 55086 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0518 19:55:47.661588 55086 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0518 19:55:47.661933 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:47.662202 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:47.662680 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:47.662762 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:47.662850 55086 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0518 19:55:47.663103 55086 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0518 19:55:47.663336 55086 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0518 19:55:47.670711 55086 target.go:111] Terraform output is in /tmp/test1753675849/out --- PASS: TestNvidia (2.12s) === RUN TestMinimalGossip I0518 19:55:47.675971 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:47.676121 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:47.676169 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:47.676221 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:47.676266 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:47.676319 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:47.676367 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:47.676398 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:47.676437 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:47.676470 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:55:47.698071 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:47.698138 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:49.131466 55086 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0518 19:55:49.133837 55086 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0518 19:55:49.137171 55086 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0518 19:55:49.137368 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:49.137542 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:49.138352 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:49.138727 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:49.138883 55086 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0518 19:55:49.139360 55086 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0518 19:55:49.140007 55086 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0518 19:55:49.145042 55086 target.go:111] Terraform output is in /tmp/test3609420412/out --- PASS: TestMinimalGossip (1.47s) === RUN TestMinimalGossipIRSA I0518 19:55:49.147577 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:49.147659 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:49.147698 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:49.147732 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:49.147758 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:49.147790 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:49.147817 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:49.147834 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:49.147857 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:49.147875 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:55:49.164076 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:49.164134 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:50.628260 55086 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0518 19:55:50.647660 55086 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0518 19:55:50.654619 55086 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0518 19:55:50.654799 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:50.655038 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:50.655191 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:50.655335 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:55:50.655412 55086 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0518 19:55:50.655587 55086 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0518 19:55:50.655788 55086 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0518 19:55:50.659162 55086 target.go:111] Terraform output is in /tmp/test4027984583/out --- PASS: TestMinimalGossipIRSA (1.51s) === RUN TestMinimalGCE I0518 19:55:50.662271 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:50.663273 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:55:52.697206 55086 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0518 19:55:52.697273 55086 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0518 19:55:52.697352 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0518 19:55:52.697372 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0518 19:55:52.697386 55086 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0518 19:55:52.697432 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0518 19:55:52.698388 55086 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0518 19:55:52.702654 55086 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0518 19:55:52.709004 55086 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0518 19:55:52.710109 55086 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0518 19:55:52.710418 55086 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0518 19:55:52.713646 55086 target.go:111] Terraform output is in /tmp/test3781423943/out --- PASS: TestMinimalGCE (2.05s) === RUN TestMinimalGCEPrivate I0518 19:55:52.717153 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:52.718922 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:55:54.392962 55086 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0518 19:55:54.393122 55086 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0518 19:55:54.393279 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W0518 19:55:54.393335 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W0518 19:55:54.393384 55086 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W0518 19:55:54.393477 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0518 19:55:54.395013 55086 executor.go:111] Tasks: 0 done / 65 total; 41 can run I0518 19:55:54.398943 55086 executor.go:111] Tasks: 41 done / 65 total; 17 can run I0518 19:55:54.429717 55086 executor.go:111] Tasks: 58 done / 65 total; 5 can run I0518 19:55:54.431690 55086 executor.go:111] Tasks: 63 done / 65 total; 2 can run I0518 19:55:54.431986 55086 executor.go:111] Tasks: 65 done / 65 total; 0 can run I0518 19:55:54.438653 55086 target.go:111] Terraform output is in /tmp/test3068136247/out --- PASS: TestMinimalGCEPrivate (1.72s) === RUN TestMinimalGCEInternalLoadBalancer I0518 19:55:54.442061 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:54.443949 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:55:56.158056 55086 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0518 19:55:56.158128 55086 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0518 19:55:56.158243 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W0518 19:55:56.158266 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W0518 19:55:56.158291 55086 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W0518 19:55:56.158350 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0518 19:55:56.158396 55086 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0518 19:55:56.159394 55086 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0518 19:55:56.162057 55086 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0518 19:55:56.162589 55086 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0518 19:55:56.162850 55086 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0518 19:55:56.167003 55086 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0518 19:55:56.167759 55086 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0518 19:55:56.167899 55086 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0518 19:55:56.168089 55086 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0518 19:55:56.168272 55086 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0518 19:55:56.171565 55086 target.go:111] Terraform output is in /tmp/test3422370211/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.73s) === RUN TestMinimalGCEPublicLoadBalancer I0518 19:55:56.174103 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:56.175375 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:55:57.878564 55086 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0518 19:55:57.878624 55086 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0518 19:55:57.878724 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W0518 19:55:57.878741 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W0518 19:55:57.878755 55086 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W0518 19:55:57.878797 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0518 19:55:57.880307 55086 executor.go:111] Tasks: 0 done / 71 total; 43 can run I0518 19:55:57.882571 55086 executor.go:111] Tasks: 43 done / 71 total; 19 can run I0518 19:55:57.888563 55086 executor.go:111] Tasks: 62 done / 71 total; 7 can run I0518 19:55:57.889657 55086 executor.go:111] Tasks: 69 done / 71 total; 2 can run I0518 19:55:57.889808 55086 executor.go:111] Tasks: 71 done / 71 total; 0 can run I0518 19:55:57.893426 55086 target.go:111] Terraform output is in /tmp/test495576240/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.72s) === RUN TestMinimalGCELongClusterName I0518 19:55:57.896442 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:57.898402 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:55:59.596736 55086 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0518 19:55:59.596843 55086 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0518 19:55:59.596947 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0518 19:55:59.596971 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0518 19:55:59.596998 55086 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0518 19:55:59.597064 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0518 19:55:59.597965 55086 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0518 19:55:59.600052 55086 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0518 19:55:59.605151 55086 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0518 19:55:59.605883 55086 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0518 19:55:59.606060 55086 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0518 19:55:59.608000 55086 target.go:111] Terraform output is in /tmp/test297472307/out --- PASS: TestMinimalGCELongClusterName (1.71s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I0518 19:55:59.609904 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:59.611032 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:56:01.472044 55086 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0518 19:56:01.472102 55086 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0518 19:56:01.472227 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0518 19:56:01.472250 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0518 19:56:01.472266 55086 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0518 19:56:01.472316 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0518 19:56:01.472349 55086 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0518 19:56:01.473428 55086 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0518 19:56:01.481048 55086 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0518 19:56:01.481386 55086 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0518 19:56:01.481564 55086 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0518 19:56:01.486714 55086 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0518 19:56:01.487331 55086 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0518 19:56:01.487460 55086 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0518 19:56:01.487595 55086 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0518 19:56:01.487741 55086 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0518 19:56:01.490648 55086 target.go:111] Terraform output is in /tmp/test4149891603/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.88s) === RUN TestMinimalGCEDNSNone I0518 19:56:01.493402 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:01.494967 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:56:03.186923 55086 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0518 19:56:03.187016 55086 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0518 19:56:03.187170 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0518 19:56:03.187201 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0518 19:56:03.187226 55086 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0518 19:56:03.187296 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0518 19:56:03.187341 55086 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0518 19:56:03.189098 55086 executor.go:111] Tasks: 0 done / 72 total; 41 can run I0518 19:56:03.193515 55086 executor.go:111] Tasks: 41 done / 72 total; 18 can run I0518 19:56:03.194279 55086 executor.go:111] Tasks: 59 done / 72 total; 2 can run I0518 19:56:03.194533 55086 executor.go:111] Tasks: 61 done / 72 total; 2 can run I0518 19:56:03.201360 55086 executor.go:111] Tasks: 63 done / 72 total; 4 can run I0518 19:56:03.202244 55086 executor.go:111] Tasks: 67 done / 72 total; 2 can run I0518 19:56:03.202400 55086 executor.go:111] Tasks: 69 done / 72 total; 1 can run I0518 19:56:03.202539 55086 executor.go:111] Tasks: 70 done / 72 total; 2 can run I0518 19:56:03.202736 55086 executor.go:111] Tasks: 72 done / 72 total; 0 can run I0518 19:56:03.205637 55086 target.go:111] Terraform output is in /tmp/test2679192348/out --- PASS: TestMinimalGCEDNSNone (1.72s) === RUN TestMinimalScaleway I0518 19:56:03.208680 55086 featureflag.go:164] FeatureFlag "Scaleway"=true I0518 19:56:03.208706 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:56:05.386029 55086 executor.go:111] Tasks: 0 done / 49 total; 37 can run I0518 19:56:05.403963 55086 executor.go:111] Tasks: 37 done / 49 total; 6 can run I0518 19:56:05.412408 55086 executor.go:111] Tasks: 43 done / 49 total; 6 can run I0518 19:56:05.414636 55086 executor.go:111] Tasks: 49 done / 49 total; 0 can run I0518 19:56:05.416925 55086 target.go:111] Terraform output is in /tmp/test2273361690/out I0518 19:56:05.419727 55086 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (2.21s) === RUN TestHA I0518 19:56:05.419907 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.420047 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:05.420093 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:05.420149 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:05.420196 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:05.420282 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:05.420370 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:05.420438 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:05.420485 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:05.420521 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:05.447475 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:05.449737 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:05.449802 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:05.449839 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:05.449875 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:06.764552 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:06.914897 55086 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0518 19:56:06.921140 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:06.921174 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:06.921233 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:06.922538 55086 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0518 19:56:06.928360 55086 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0518 19:56:06.928616 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:06.928774 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:06.929001 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:06.929215 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:06.929335 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:06.929411 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:06.929476 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:06.929548 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:06.929644 55086 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0518 19:56:06.929979 55086 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0518 19:56:06.930280 55086 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0518 19:56:06.937336 55086 target.go:111] Terraform output is in /tmp/test504756418/out --- PASS: TestHA (1.52s) === RUN TestHighAvailabilityGCE I0518 19:56:06.942360 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:06.943700 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:56:08.667822 55086 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0518 19:56:08.667895 55086 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0518 19:56:08.667980 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W0518 19:56:08.667997 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W0518 19:56:08.668012 55086 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W0518 19:56:08.668055 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0518 19:56:08.668106 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0518 19:56:08.668146 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0518 19:56:08.669269 55086 executor.go:111] Tasks: 0 done / 82 total; 49 can run I0518 19:56:08.672600 55086 executor.go:111] Tasks: 49 done / 82 total; 19 can run I0518 19:56:08.677642 55086 executor.go:111] Tasks: 68 done / 82 total; 8 can run I0518 19:56:08.678482 55086 executor.go:111] Tasks: 76 done / 82 total; 6 can run I0518 19:56:08.678736 55086 executor.go:111] Tasks: 82 done / 82 total; 0 can run I0518 19:56:08.681228 55086 target.go:111] Terraform output is in /tmp/test1757551489/out --- PASS: TestHighAvailabilityGCE (1.74s) === RUN TestComplex I0518 19:56:08.685089 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:08.685276 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:08.685388 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:08.685606 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:08.686017 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:08.686072 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:08.686107 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:08.686777 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:08.686814 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:08.686835 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:08.714132 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:56:08.718209 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:08.718307 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:10.809053 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:10.932977 55086 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0518 19:56:10.934052 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:10.934074 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:10.934131 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:10.937617 55086 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0518 19:56:10.940106 55086 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0518 19:56:10.940716 55086 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0518 19:56:10.940854 55086 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0518 19:56:10.940894 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:10.940944 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:10.941041 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:10.941103 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:10.944111 55086 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0518 19:56:10.944205 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:10.944356 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:10.944535 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:10.944832 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:10.944891 55086 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0518 19:56:10.945047 55086 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0518 19:56:10.945228 55086 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0518 19:56:10.949854 55086 target.go:111] Terraform output is in /tmp/test2452172200/out I0518 19:56:10.953447 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:10.953560 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:10.953612 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:10.953662 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:10.953704 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:10.953753 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:10.953799 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:10.953830 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:10.953870 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:10.953898 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:10.972682 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:56:10.975133 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:10.975196 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:12.302566 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:12.437454 55086 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0518 19:56:12.438126 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:12.438162 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:12.438224 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:12.439129 55086 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0518 19:56:12.440856 55086 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0518 19:56:12.441336 55086 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0518 19:56:12.441488 55086 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0518 19:56:12.441522 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:12.441569 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:12.441672 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:12.441721 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:12.447900 55086 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0518 19:56:12.448080 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:12.448258 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:12.448470 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:12.448736 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:12.448814 55086 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0518 19:56:12.449012 55086 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0518 19:56:12.449225 55086 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0518 19:56:12.452935 55086 target.go:111] Terraform output is in /tmp/test2102214377/out --- PASS: TestComplex (3.77s) === RUN TestCompress I0518 19:56:12.455704 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:12.455782 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:12.455811 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:12.455841 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:12.455865 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:12.455899 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:12.455925 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:12.455945 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:12.455970 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:12.455989 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:12.469287 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:12.471147 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:12.471204 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:13.783692 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:13.932935 55086 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0518 19:56:13.933277 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:13.933311 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:13.933405 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:13.938213 55086 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0518 19:56:13.943202 55086 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0518 19:56:13.943654 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:13.943886 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:13.944510 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:13.945245 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:13.945353 55086 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0518 19:56:13.945620 55086 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0518 19:56:13.945845 55086 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0518 19:56:13.950861 55086 target.go:111] Terraform output is in /tmp/test3522892574/out --- PASS: TestCompress (1.50s) === RUN TestExternalPolicies I0518 19:56:13.955028 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:13.955161 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:13.955207 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:13.955259 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:13.955306 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:13.955359 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:13.955404 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:13.955437 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:13.955479 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:13.955512 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:13.995455 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:13.998548 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:13.998607 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:15.309184 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:15.469858 55086 executor.go:111] Tasks: 0 done / 115 total; 47 can run I0518 19:56:15.493663 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:15.493708 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:15.493788 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:15.499141 55086 executor.go:111] Tasks: 47 done / 115 total; 22 can run I0518 19:56:15.505057 55086 executor.go:111] Tasks: 69 done / 115 total; 30 can run I0518 19:56:15.507065 55086 executor.go:111] Tasks: 99 done / 115 total; 4 can run W0518 19:56:15.507254 55086 api.go:53] PageSize not implemented W0518 19:56:15.507750 55086 api.go:53] PageSize not implemented I0518 19:56:15.511856 55086 executor.go:111] Tasks: 103 done / 115 total; 4 can run I0518 19:56:15.512056 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:15.512277 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:15.512681 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:15.512767 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:15.512885 55086 executor.go:111] Tasks: 107 done / 115 total; 2 can run I0518 19:56:15.513137 55086 executor.go:111] Tasks: 109 done / 115 total; 6 can run I0518 19:56:15.513395 55086 executor.go:111] Tasks: 115 done / 115 total; 0 can run I0518 19:56:15.519518 55086 target.go:111] Terraform output is in /tmp/test4142023752/out --- PASS: TestExternalPolicies (1.57s) === RUN TestMinimalIPv6 I0518 19:56:15.524190 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:15.524331 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:15.524395 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:15.524450 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:15.524494 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:15.524552 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:15.524598 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:15.524629 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:15.524677 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:15.524708 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:15.553050 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:56:15.556492 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:15.556582 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:16.857161 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:16.972000 55086 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0518 19:56:16.977230 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:16.977268 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:16.977346 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:16.979154 55086 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0518 19:56:16.981149 55086 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0518 19:56:16.981635 55086 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0518 19:56:16.981996 55086 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0518 19:56:16.982094 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:16.982174 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:16.982272 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:16.982325 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:16.987290 55086 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0518 19:56:16.987456 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:16.987649 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:16.987877 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:16.988122 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:16.988192 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:56:16.988384 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:56:16.988618 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0518 19:56:16.992518 55086 target.go:111] Terraform output is in /tmp/test4170352390/out --- PASS: TestMinimalIPv6 (1.47s) === RUN TestMinimalIPv6Calico I0518 19:56:16.995208 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:16.995300 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:16.995334 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:16.995370 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:16.995396 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:16.995429 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:16.995489 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:16.995507 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:16.995533 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:16.995552 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:17.015452 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:56:17.018341 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:17.018446 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:18.320708 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:18.810187 55086 executor.go:111] Tasks: 0 done / 138 total; 47 can run I0518 19:56:18.810460 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:18.810488 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:18.810571 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:18.812475 55086 executor.go:111] Tasks: 47 done / 138 total; 25 can run I0518 19:56:18.818451 55086 executor.go:111] Tasks: 72 done / 138 total; 37 can run I0518 19:56:18.819012 55086 executor.go:111] Tasks: 109 done / 138 total; 9 can run I0518 19:56:18.819354 55086 executor.go:111] Tasks: 118 done / 138 total; 8 can run I0518 19:56:18.819463 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:18.819544 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:18.819644 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:18.819718 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:18.825832 55086 executor.go:111] Tasks: 126 done / 138 total; 4 can run I0518 19:56:18.826328 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:18.826578 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:18.826854 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:18.827036 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:18.827104 55086 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0518 19:56:18.827377 55086 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0518 19:56:18.827598 55086 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0518 19:56:18.833730 55086 target.go:111] Terraform output is in /tmp/test1210867044/out --- PASS: TestMinimalIPv6Calico (1.84s) === RUN TestMinimalIPv6Cilium I0518 19:56:18.838653 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:18.838742 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:18.838776 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:18.838810 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:18.838835 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:18.838866 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:18.838921 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:18.838939 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:18.838964 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:18.838981 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:18.856471 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:56:18.858768 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:18.858825 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:20.140970 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:20.307405 55086 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0518 19:56:20.310054 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:20.310076 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:20.310131 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:20.310848 55086 executor.go:111] Tasks: 47 done / 137 total; 25 can run I0518 19:56:20.312834 55086 executor.go:111] Tasks: 72 done / 137 total; 36 can run I0518 19:56:20.313331 55086 executor.go:111] Tasks: 108 done / 137 total; 9 can run I0518 19:56:20.313602 55086 executor.go:111] Tasks: 117 done / 137 total; 8 can run I0518 19:56:20.313671 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:20.313736 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:20.313834 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:20.313892 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:20.317299 55086 executor.go:111] Tasks: 125 done / 137 total; 4 can run I0518 19:56:20.317413 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:20.317607 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:20.317860 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:20.318020 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:20.318111 55086 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0518 19:56:20.319150 55086 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0518 19:56:20.321088 55086 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0518 19:56:20.326625 55086 target.go:111] Terraform output is in /tmp/test762174323/out --- PASS: TestMinimalIPv6Cilium (1.49s) === RUN TestMinimalIPv6NoSubnetPrefix I0518 19:56:20.329461 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:20.329548 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:20.329580 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:20.329611 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:20.329636 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:20.329667 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:20.329695 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:20.329712 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:20.329735 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:20.329754 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:20.353695 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:56:20.357533 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:20.357644 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:21.667425 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:21.791275 55086 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0518 19:56:21.793661 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:21.793702 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:21.793762 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:21.796723 55086 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0518 19:56:21.799083 55086 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0518 19:56:21.799706 55086 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0518 19:56:21.800040 55086 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0518 19:56:21.800164 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:21.800218 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:21.800303 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:56:21.800346 55086 loadbalancers.go:35] PageSize not implemented I0518 19:56:21.803408 55086 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0518 19:56:21.803511 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:21.803676 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:21.803783 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:21.804161 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:21.804230 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:56:21.804443 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:56:21.804677 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0518 19:56:21.808404 55086 target.go:111] Terraform output is in /tmp/test4050779842/out --- PASS: TestMinimalIPv6NoSubnetPrefix (1.48s) === RUN TestMinimalWarmPool I0518 19:56:21.811110 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:21.811192 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:21.811221 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:21.811253 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:21.811277 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:21.811311 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:21.811338 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:21.811354 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:21.811381 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:21.811398 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:21.831344 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:21.834627 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:21.834719 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:23.134708 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:23.333643 55086 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0518 19:56:23.334040 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:23.334078 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:23.334169 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:23.339072 55086 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0518 19:56:23.343283 55086 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0518 19:56:23.343689 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:23.343866 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:23.344071 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:23.344385 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:23.344470 55086 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0518 19:56:23.344687 55086 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0518 19:56:23.344928 55086 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0518 19:56:23.350140 55086 target.go:111] Terraform output is in /tmp/test4012352631/out --- PASS: TestMinimalWarmPool (1.54s) === RUN TestMinimalEtcd I0518 19:56:23.354726 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:23.354819 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:23.354868 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:23.354926 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:23.354946 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:23.354971 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:23.354994 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:23.355008 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:23.355027 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:23.355041 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:23.378925 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:23.381571 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:23.381645 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:24.713419 55086 zones.go:93] ListHostedZonesPages { } W0518 19:56:24.842558 55086 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W0518 19:56:24.842598 55086 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W0518 19:56:24.844115 55086 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I0518 19:56:24.851721 55086 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0518 19:56:24.853088 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:24.853108 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:24.853169 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:24.854013 55086 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0518 19:56:24.857891 55086 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0518 19:56:24.858166 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:24.858324 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:24.858458 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:24.858718 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:24.858781 55086 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0518 19:56:24.858945 55086 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0518 19:56:24.859142 55086 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0518 19:56:24.862023 55086 target.go:111] Terraform output is in /tmp/test4158316113/out --- PASS: TestMinimalEtcd (1.51s) === RUN TestMinimalGp3 I0518 19:56:24.865872 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:24.866001 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:24.866039 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:24.866103 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:24.866192 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:24.866373 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:24.866483 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:24.866894 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:24.866958 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:24.866980 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:24.881969 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:24.883772 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:24.883826 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:26.160252 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:26.324460 55086 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0518 19:56:26.325351 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:26.325383 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:26.325510 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:26.327675 55086 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0518 19:56:26.338109 55086 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0518 19:56:26.338610 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:26.338803 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:26.339329 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:26.339423 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:26.339571 55086 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0518 19:56:26.339941 55086 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0518 19:56:26.340199 55086 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0518 19:56:26.345789 55086 target.go:111] Terraform output is in /tmp/test3296620207/out --- PASS: TestMinimalGp3 (1.48s) === RUN TestMinimalLongClusterName I0518 19:56:26.350306 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:26.350428 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:26.350472 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:26.350523 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:26.350570 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:26.350624 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:26.350666 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:26.350695 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:26.350732 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:26.350761 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:26.374177 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:26.377332 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:26.377414 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0518 19:56:27.670426 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:27.841178 55086 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0518 19:56:27.841962 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:27.842004 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:27.842108 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:27.843349 55086 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0518 19:56:27.851543 55086 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0518 19:56:27.851753 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:27.852093 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:27.852326 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:27.852978 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:27.853085 55086 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0518 19:56:27.853382 55086 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0518 19:56:27.853751 55086 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0518 19:56:27.858964 55086 target.go:111] Terraform output is in /tmp/test563650740/out --- PASS: TestMinimalLongClusterName (1.51s) === RUN TestExistingSG I0518 19:56:27.863614 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:27.863760 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:27.863804 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:27.863849 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:27.863892 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:27.863943 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:27.863989 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:27.864020 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:27.864060 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:27.864089 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:27.893561 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:27.897276 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:27.897364 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:27.897421 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:27.897479 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:29.229435 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:29.414197 55086 executor.go:111] Tasks: 0 done / 163 total; 53 can run I0518 19:56:29.415019 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:29.415062 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:29.415163 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:29.417649 55086 executor.go:111] Tasks: 53 done / 163 total; 26 can run I0518 19:56:29.420760 55086 executor.go:111] Tasks: 79 done / 163 total; 54 can run I0518 19:56:29.421964 55086 executor.go:111] Tasks: 133 done / 163 total; 6 can run W0518 19:56:29.422014 55086 api.go:53] PageSize not implemented W0518 19:56:29.422196 55086 api.go:53] PageSize not implemented W0518 19:56:29.422345 55086 api.go:53] PageSize not implemented W0518 19:56:29.422536 55086 api.go:53] PageSize not implemented I0518 19:56:29.427866 55086 executor.go:111] Tasks: 139 done / 163 total; 8 can run I0518 19:56:29.428120 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:29.428263 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:29.428526 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:29.428755 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:29.428897 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:29.428965 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:29.429064 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:29.429128 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:29.429215 55086 executor.go:111] Tasks: 147 done / 163 total; 4 can run I0518 19:56:29.429521 55086 executor.go:111] Tasks: 151 done / 163 total; 12 can run I0518 19:56:29.429891 55086 executor.go:111] Tasks: 163 done / 163 total; 0 can run I0518 19:56:29.437806 55086 target.go:111] Terraform output is in /tmp/test3723288160/out --- PASS: TestExistingSG (1.58s) === RUN TestBastionAdditionalUserData I0518 19:56:29.446658 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:29.446808 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:29.446854 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:29.446908 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:29.446951 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:29.447002 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:29.447047 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:29.447078 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:29.447118 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:29.447147 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:29.475865 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:29.479268 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:29.479353 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:29.479415 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:30.782667 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:30.902994 55086 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0518 19:56:30.903556 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:30.903697 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:30.903917 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:30.932230 55086 executor.go:111] Tasks: 47 done / 137 total; 30 can run I0518 19:56:30.939353 55086 executor.go:111] Tasks: 77 done / 137 total; 35 can run I0518 19:56:30.942202 55086 executor.go:111] Tasks: 112 done / 137 total; 6 can run W0518 19:56:30.942495 55086 api.go:53] PageSize not implemented W0518 19:56:30.948443 55086 api.go:53] PageSize not implemented W0518 19:56:30.948565 55086 api.go:53] PageSize not implemented I0518 19:56:30.962813 55086 executor.go:111] Tasks: 118 done / 137 total; 7 can run I0518 19:56:30.963142 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:30.963520 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:30.963901 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:30.964305 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:30.964470 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:30.965123 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:30.965207 55086 executor.go:111] Tasks: 125 done / 137 total; 3 can run I0518 19:56:30.965733 55086 executor.go:111] Tasks: 128 done / 137 total; 9 can run I0518 19:56:30.966319 55086 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0518 19:56:30.972038 55086 target.go:111] Terraform output is in /tmp/test4164549179/out --- PASS: TestBastionAdditionalUserData (1.53s) === RUN TestPrivateFlannel I0518 19:56:30.976033 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:30.976132 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:30.976170 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:30.976215 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:30.976251 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:30.976295 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:30.976371 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:30.976402 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:30.976438 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:30.976462 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:31.004929 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:56:31.007966 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:31.008039 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:31.008098 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:32.346684 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:32.534084 55086 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0518 19:56:32.535286 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:32.535337 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:32.535473 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:32.537020 55086 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0518 19:56:32.539024 55086 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0518 19:56:32.539389 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:32.539607 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:32.539739 55086 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0518 19:56:32.539871 55086 api.go:53] PageSize not implemented W0518 19:56:32.539955 55086 api.go:53] PageSize not implemented I0518 19:56:32.545498 55086 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0518 19:56:32.545849 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:32.546130 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:32.546541 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:32.546625 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:32.546705 55086 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0518 19:56:32.546964 55086 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0518 19:56:32.547305 55086 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0518 19:56:32.554025 55086 target.go:111] Terraform output is in /tmp/test3071831801/out --- PASS: TestPrivateFlannel (1.58s) === RUN TestPrivateCalico I0518 19:56:32.559044 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:32.559171 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:32.559213 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:32.559257 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:32.559295 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:32.559350 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:32.559430 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:32.559461 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:32.559500 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:32.559529 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:32.587501 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:56:32.590627 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:32.590704 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:32.590757 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:33.861982 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:34.260407 55086 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0518 19:56:34.261476 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:34.261523 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:34.261599 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:34.264270 55086 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0518 19:56:34.271206 55086 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0518 19:56:34.272262 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:34.272530 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:34.273047 55086 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0518 19:56:34.273172 55086 api.go:53] PageSize not implemented W0518 19:56:34.273303 55086 api.go:53] PageSize not implemented I0518 19:56:34.279341 55086 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0518 19:56:34.279460 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:34.279648 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:34.280220 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:34.280355 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:34.280492 55086 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0518 19:56:34.280957 55086 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0518 19:56:34.281456 55086 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0518 19:56:34.287772 55086 target.go:111] Terraform output is in /tmp/test3785618347/out --- PASS: TestPrivateCalico (1.74s) === RUN TestPrivateCilium I0518 19:56:34.297652 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:34.297873 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:34.297952 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:34.298034 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:34.298124 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:34.298222 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:34.298305 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:34.298368 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:34.298447 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:34.298503 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:34.342653 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:34.346804 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:34.346886 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:34.346943 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:35.618480 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:35.813506 55086 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0518 19:56:35.814755 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:35.814780 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:35.814857 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:35.817787 55086 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0518 19:56:35.819823 55086 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0518 19:56:35.820108 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:35.820245 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:35.820326 55086 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0518 19:56:35.820426 55086 api.go:53] PageSize not implemented W0518 19:56:35.820557 55086 api.go:53] PageSize not implemented I0518 19:56:35.826092 55086 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0518 19:56:35.826395 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:35.826629 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:35.826927 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:35.827070 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:35.827183 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:56:35.827440 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:56:35.827735 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0518 19:56:35.835239 55086 target.go:111] Terraform output is in /tmp/test3124491094/out --- PASS: TestPrivateCilium (1.54s) === RUN TestPrivateCilium2 I0518 19:56:35.839201 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:35.839289 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:35.839320 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:35.839354 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:35.839381 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:35.839416 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:35.839470 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:35.839489 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:35.839513 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:35.839532 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:35.855899 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:56:35.858080 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:35.858133 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:35.858169 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:37.132456 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:37.782011 55086 executor.go:111] Tasks: 0 done / 138 total; 50 can run I0518 19:56:37.782636 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:37.782667 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:37.782751 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:37.787054 55086 executor.go:111] Tasks: 50 done / 138 total; 30 can run I0518 19:56:37.794189 55086 executor.go:111] Tasks: 80 done / 138 total; 36 can run I0518 19:56:37.795148 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:37.795321 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:37.795438 55086 executor.go:111] Tasks: 116 done / 138 total; 6 can run W0518 19:56:37.795575 55086 api.go:53] PageSize not implemented W0518 19:56:37.795703 55086 api.go:53] PageSize not implemented I0518 19:56:37.801424 55086 executor.go:111] Tasks: 122 done / 138 total; 8 can run I0518 19:56:37.801610 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:37.801813 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:37.802103 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:37.802343 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:37.802435 55086 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0518 19:56:37.802751 55086 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0518 19:56:37.803079 55086 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0518 19:56:37.810533 55086 target.go:111] Terraform output is in /tmp/test3005583850/out --- PASS: TestPrivateCilium2 (1.98s) === RUN TestPrivateCiliumAdvanced I0518 19:56:37.818622 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:37.818781 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:37.818828 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:37.818881 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:37.818933 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:37.818992 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:37.819035 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:37.819071 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:37.819109 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:37.819147 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:37.853886 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:37.860092 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:37.860205 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:37.860275 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:39.141916 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:39.381182 55086 executor.go:111] Tasks: 0 done / 142 total; 54 can run I0518 19:56:39.381488 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:39.381519 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:39.381615 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:39.386024 55086 executor.go:111] Tasks: 54 done / 142 total; 30 can run I0518 19:56:39.391996 55086 executor.go:111] Tasks: 84 done / 142 total; 36 can run I0518 19:56:39.392872 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:39.393073 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:39.393290 55086 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0518 19:56:39.393365 55086 api.go:53] PageSize not implemented W0518 19:56:39.393635 55086 api.go:53] PageSize not implemented I0518 19:56:39.400887 55086 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0518 19:56:39.401091 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:39.401222 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:39.401729 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:39.401969 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:39.402080 55086 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0518 19:56:39.402377 55086 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0518 19:56:39.402751 55086 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0518 19:56:39.409727 55086 target.go:111] Terraform output is in /tmp/test4082805831/out --- PASS: TestPrivateCiliumAdvanced (1.60s) === RUN TestPrivateCiliumENI I0518 19:56:39.415106 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:39.415234 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:39.415276 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:39.415326 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:39.415371 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:39.415427 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:39.415469 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:39.415500 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:39.415540 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:39.415571 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:39.442910 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:39.446582 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:39.446670 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:39.446728 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:41.026997 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:41.236149 55086 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0518 19:56:41.236770 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:41.236800 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:41.236889 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:41.241559 55086 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0518 19:56:41.246558 55086 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0518 19:56:41.247151 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:41.247366 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:41.247498 55086 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0518 19:56:41.247648 55086 api.go:53] PageSize not implemented W0518 19:56:41.247778 55086 api.go:53] PageSize not implemented I0518 19:56:41.253195 55086 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0518 19:56:41.253387 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:41.253580 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:41.253861 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:41.254415 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:41.254558 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:56:41.254928 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:56:41.255393 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0518 19:56:41.262264 55086 target.go:111] Terraform output is in /tmp/test2674486056/out --- PASS: TestPrivateCiliumENI (1.85s) === RUN TestPrivateCanal I0518 19:56:41.268202 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:41.268326 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:41.268368 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:41.268416 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:41.268466 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:41.268520 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:41.268605 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:41.268640 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:41.268682 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:41.268712 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:41.295749 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:56:41.298921 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:41.298992 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:41.299044 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:42.619257 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:43.006505 55086 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0518 19:56:43.006800 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:43.006842 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:43.006941 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:43.008800 55086 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0518 19:56:43.011126 55086 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0518 19:56:43.011741 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:43.011915 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:43.012014 55086 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0518 19:56:43.012121 55086 api.go:53] PageSize not implemented W0518 19:56:43.012212 55086 api.go:53] PageSize not implemented I0518 19:56:43.018168 55086 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0518 19:56:43.018327 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:43.018435 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:43.018737 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:43.019174 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:43.019300 55086 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0518 19:56:43.019649 55086 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0518 19:56:43.019998 55086 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0518 19:56:43.026818 55086 target.go:111] Terraform output is in /tmp/test4115715670/out --- PASS: TestPrivateCanal (1.76s) === RUN TestPrivateKopeio I0518 19:56:43.032581 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:43.032708 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:43.032778 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:43.032830 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:43.032872 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:43.032922 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:43.032963 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:43.032991 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:43.033029 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:43.033058 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:43.061374 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:43.064191 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:43.064264 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:43.064304 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:44.333566 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:44.512130 55086 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0518 19:56:44.513134 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:44.513164 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:44.513244 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:44.515504 55086 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0518 19:56:44.519144 55086 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0518 19:56:44.519665 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:44.519844 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:44.520128 55086 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0518 19:56:44.520185 55086 api.go:53] PageSize not implemented W0518 19:56:44.520250 55086 api.go:53] PageSize not implemented I0518 19:56:44.528575 55086 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0518 19:56:44.528825 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:44.529090 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:44.529544 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:44.529633 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:44.529718 55086 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0518 19:56:44.530038 55086 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0518 19:56:44.530361 55086 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0518 19:56:44.537282 55086 target.go:111] Terraform output is in /tmp/test848690105/out --- PASS: TestPrivateKopeio (1.51s) === RUN TestUnmanaged I0518 19:56:44.542444 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:44.542578 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:44.542621 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:44.542673 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:44.542715 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:44.542771 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:44.542816 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:44.542846 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:44.542885 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:44.542914 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:44.572228 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:44.575435 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:44.575505 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:44.575555 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:45.892056 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:46.060636 55086 executor.go:111] Tasks: 0 done / 126 total; 46 can run I0518 19:56:46.063871 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:46.063948 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:46.064095 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:46.065530 55086 executor.go:111] Tasks: 46 done / 126 total; 27 can run I0518 19:56:46.070130 55086 executor.go:111] Tasks: 73 done / 126 total; 33 can run I0518 19:56:46.070674 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:46.070872 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:46.071241 55086 executor.go:111] Tasks: 106 done / 126 total; 5 can run W0518 19:56:46.071416 55086 api.go:53] PageSize not implemented W0518 19:56:46.071543 55086 api.go:53] PageSize not implemented I0518 19:56:46.077177 55086 executor.go:111] Tasks: 111 done / 126 total; 7 can run I0518 19:56:46.077363 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:46.077589 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:46.077831 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:46.078319 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:46.078429 55086 executor.go:111] Tasks: 118 done / 126 total; 2 can run I0518 19:56:46.078713 55086 executor.go:111] Tasks: 120 done / 126 total; 6 can run I0518 19:56:46.079123 55086 executor.go:111] Tasks: 126 done / 126 total; 0 can run I0518 19:56:46.085706 55086 target.go:111] Terraform output is in /tmp/test1566378731/out --- PASS: TestUnmanaged (1.55s) === RUN TestPrivateSharedSubnet I0518 19:56:46.090451 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:46.090583 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:46.090632 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:46.090690 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:46.090734 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:46.090789 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:46.090833 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:46.090862 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:46.090902 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:46.090931 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:46.116724 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:46.118912 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:46.118970 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:46.119006 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:47.431057 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:47.600842 55086 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0518 19:56:47.601407 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:47.601459 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:47.601551 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:47.603459 55086 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0518 19:56:47.603811 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:56:47.606376 55086 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0518 19:56:47.606908 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:47.607019 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:47.607094 55086 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0518 19:56:47.607122 55086 api.go:53] PageSize not implemented W0518 19:56:47.607217 55086 api.go:53] PageSize not implemented I0518 19:56:47.610571 55086 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0518 19:56:47.610710 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:47.610873 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:47.611220 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:47.611304 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:47.611436 55086 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0518 19:56:47.611712 55086 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0518 19:56:47.612022 55086 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0518 19:56:47.619342 55086 target.go:111] Terraform output is in /tmp/test1301464213/out --- PASS: TestPrivateSharedSubnet (1.53s) === RUN TestPrivateSharedIP I0518 19:56:47.622459 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:47.622589 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:47.622637 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:47.622696 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:47.622748 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:47.622810 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:47.622864 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:47.622907 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:47.622951 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:47.622981 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:47.643361 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:47.646809 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:47.646900 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:47.646961 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:48.917494 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:49.098024 55086 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0518 19:56:49.098826 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:49.098862 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:49.098968 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:49.100171 55086 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0518 19:56:49.100620 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:56:49.103129 55086 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0518 19:56:49.103673 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:49.103788 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:49.103866 55086 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0518 19:56:49.103923 55086 api.go:53] PageSize not implemented W0518 19:56:49.103967 55086 api.go:53] PageSize not implemented I0518 19:56:49.107132 55086 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0518 19:56:49.107227 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:49.107393 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:49.107619 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:49.107911 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:49.108034 55086 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0518 19:56:49.108309 55086 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0518 19:56:49.108624 55086 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0518 19:56:49.112664 55086 target.go:111] Terraform output is in /tmp/test2496772062/out --- PASS: TestPrivateSharedIP (1.49s) === RUN TestPrivateDns1 I0518 19:56:49.115425 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:49.115502 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:49.115527 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:49.115559 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:49.115583 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:49.115615 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:49.115643 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:49.115659 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:49.115683 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:49.115701 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0518 19:56:49.136400 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:49.136591 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:49.136723 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:50.921225 55086 executor.go:111] Tasks: 0 done / 135 total; 46 can run I0518 19:56:50.924181 55086 executor.go:111] Tasks: 46 done / 135 total; 28 can run I0518 19:56:50.924573 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I0518 19:56:50.924637 55086 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I0518 19:56:50.924740 55086 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I0518 19:56:50.924758 55086 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I0518 19:56:50.925530 55086 executor.go:111] Tasks: 74 done / 135 total; 39 can run I0518 19:56:50.929620 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:50.929800 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:50.932060 55086 executor.go:111] Tasks: 113 done / 135 total; 6 can run W0518 19:56:50.932190 55086 api.go:53] PageSize not implemented W0518 19:56:50.932335 55086 api.go:53] PageSize not implemented I0518 19:56:50.937913 55086 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0518 19:56:50.938254 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:50.938588 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:50.939075 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:50.939485 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:50.939602 55086 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0518 19:56:50.939936 55086 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0518 19:56:50.940354 55086 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0518 19:56:50.947347 55086 target.go:111] Terraform output is in /tmp/test3651305436/out --- PASS: TestPrivateDns1 (1.84s) === RUN TestPrivateDns2 I0518 19:56:50.952208 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:50.952289 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:50.952316 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:50.952347 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:50.952374 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:50.952408 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:50.952436 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:50.952453 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:50.952498 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:50.952530 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:50.971950 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:50.972004 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:50.972043 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:52.431677 55086 executor.go:111] Tasks: 0 done / 132 total; 45 can run I0518 19:56:52.436545 55086 executor.go:111] Tasks: 45 done / 132 total; 26 can run I0518 19:56:52.436862 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I0518 19:56:52.436865 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:56:52.436913 55086 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I0518 19:56:52.437074 55086 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I0518 19:56:52.437102 55086 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I0518 19:56:52.437403 55086 executor.go:111] Tasks: 71 done / 132 total; 39 can run I0518 19:56:52.437916 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:52.438169 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:52.440042 55086 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0518 19:56:52.440140 55086 api.go:53] PageSize not implemented W0518 19:56:52.440251 55086 api.go:53] PageSize not implemented I0518 19:56:52.445831 55086 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0518 19:56:52.446083 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:52.446309 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:52.446614 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:52.446725 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:52.446797 55086 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0518 19:56:52.447123 55086 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0518 19:56:52.447373 55086 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0518 19:56:52.453789 55086 target.go:111] Terraform output is in /tmp/test3176628949/out --- PASS: TestPrivateDns2 (1.51s) === RUN TestDiscoveryFeatureGate I0518 19:56:52.458587 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:52.458718 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:52.458762 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:52.458812 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:52.458853 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:52.458905 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:52.458985 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:52.459017 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:52.459058 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:52.459086 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:52.484528 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:56:52.486450 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:52.486507 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:53.768214 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:53.972245 55086 executor.go:111] Tasks: 0 done / 113 total; 52 can run I0518 19:56:53.972532 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:53.972567 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:53.972628 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:53.975123 55086 executor.go:111] Tasks: 52 done / 113 total; 28 can run I0518 19:56:53.979105 55086 executor.go:111] Tasks: 80 done / 113 total; 25 can run I0518 19:56:53.979359 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:53.979505 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:53.979782 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:53.979947 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:53.980075 55086 executor.go:111] Tasks: 105 done / 113 total; 2 can run I0518 19:56:53.980299 55086 executor.go:111] Tasks: 107 done / 113 total; 6 can run I0518 19:56:53.980669 55086 executor.go:111] Tasks: 113 done / 113 total; 0 can run I0518 19:56:53.986491 55086 target.go:111] Terraform output is in /tmp/test379329509/out --- PASS: TestDiscoveryFeatureGate (1.53s) === RUN TestVFSServiceAccountIssuerDiscovery I0518 19:56:53.992196 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:53.992323 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:53.992367 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:53.992414 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:53.992455 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:53.992507 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:53.992554 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:53.992587 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:53.992626 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:53.992655 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:54.011782 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:54.013688 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:54.013746 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:55.317364 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:55.488209 55086 executor.go:111] Tasks: 0 done / 104 total; 47 can run I0518 19:56:55.488422 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:55.488439 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:55.488500 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:55.494460 55086 executor.go:111] Tasks: 47 done / 104 total; 24 can run I0518 19:56:55.500875 55086 executor.go:111] Tasks: 71 done / 104 total; 25 can run I0518 19:56:55.501212 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:55.501408 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:55.501774 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:55.501828 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:55.501872 55086 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0518 19:56:55.502148 55086 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0518 19:56:55.502465 55086 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0518 19:56:55.508158 55086 target.go:111] Terraform output is in /tmp/test1547066368/out --- PASS: TestVFSServiceAccountIssuerDiscovery (1.52s) === RUN TestAWSLBController I0518 19:56:55.512856 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:55.513038 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:55.513094 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:55.513154 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:55.513214 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:55.513279 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:55.513327 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:55.513373 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:55.513417 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:55.513458 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:55.539641 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:55.542890 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:55.542972 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:56.855926 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:57.482778 55086 executor.go:111] Tasks: 0 done / 116 total; 54 can run I0518 19:56:57.484458 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:57.484481 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:57.484538 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:57.487106 55086 executor.go:111] Tasks: 54 done / 116 total; 29 can run I0518 19:56:57.494984 55086 executor.go:111] Tasks: 83 done / 116 total; 25 can run I0518 19:56:57.495521 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:57.495720 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:57.495949 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:57.496280 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:57.496352 55086 executor.go:111] Tasks: 108 done / 116 total; 2 can run I0518 19:56:57.496546 55086 executor.go:111] Tasks: 110 done / 116 total; 6 can run I0518 19:56:57.496793 55086 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0518 19:56:57.500894 55086 target.go:111] Terraform output is in /tmp/test2876729309/out --- PASS: TestAWSLBController (1.99s) === RUN TestManyAddons I0518 19:56:57.506145 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:57.506223 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:57.506251 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:57.506283 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:57.506309 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:57.506341 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:57.506370 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:57.506387 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:57.506410 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:57.506427 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:57.525193 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:57.528276 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:57.528352 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:58.813005 55086 zones.go:93] ListHostedZonesPages { } I0518 19:56:59.589174 55086 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0518 19:56:59.589852 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:56:59.589899 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:56:59.589986 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:56:59.592582 55086 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0518 19:56:59.597636 55086 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0518 19:56:59.598033 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:59.598228 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:59.598378 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:59.598757 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:59.598862 55086 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0518 19:56:59.599073 55086 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0518 19:56:59.599436 55086 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0518 19:56:59.604423 55086 target.go:111] Terraform output is in /tmp/test2715931486/out --- PASS: TestManyAddons (2.11s) === RUN TestManyAddonsCCMIRSA I0518 19:56:59.615103 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:59.615264 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:59.615309 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:59.615357 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:59.615396 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:59.615443 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:59.615484 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:59.615513 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:59.615547 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:59.615572 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:59.640375 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:56:59.644698 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:56:59.644814 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:00.924178 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:01.733719 55086 executor.go:111] Tasks: 0 done / 123 total; 59 can run I0518 19:57:01.735624 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:01.735655 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:01.735746 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:01.737872 55086 executor.go:111] Tasks: 59 done / 123 total; 30 can run I0518 19:57:01.744915 55086 executor.go:111] Tasks: 89 done / 123 total; 26 can run I0518 19:57:01.745207 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:01.745459 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:01.745850 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:01.745931 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:01.746049 55086 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0518 19:57:01.746332 55086 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0518 19:57:01.746635 55086 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0518 19:57:01.754163 55086 target.go:111] Terraform output is in /tmp/test3659501560/out --- PASS: TestManyAddonsCCMIRSA (2.15s) === RUN TestManyAddonsCCMIRSA23 I0518 19:57:01.764744 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:01.764873 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:01.764917 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:01.764966 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:01.765008 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:01.765058 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:01.765102 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:01.765132 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:01.765172 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:01.765201 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:01.797029 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0518 19:57:01.801320 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:01.801418 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:03.118962 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:03.877973 55086 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0518 19:57:03.878791 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:03.878819 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:03.878890 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:03.881976 55086 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0518 19:57:03.887572 55086 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0518 19:57:03.887885 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:03.888111 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:03.888434 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:03.888747 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:03.888862 55086 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0518 19:57:03.889119 55086 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0518 19:57:03.889354 55086 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0518 19:57:03.901833 55086 target.go:111] Terraform output is in /tmp/test2465393489/out --- PASS: TestManyAddonsCCMIRSA23 (2.15s) === RUN TestManyAddonsCCMIRSA24 I0518 19:57:03.912367 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:03.912516 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:03.912574 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:03.912636 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:03.912685 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:03.912740 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:03.912793 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:03.912820 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:03.912868 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:03.912906 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:03.938349 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:57:03.940989 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:03.941077 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:05.211859 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:05.983902 55086 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0518 19:57:05.984137 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:05.984163 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:05.984235 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:05.990979 55086 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0518 19:57:05.997415 55086 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0518 19:57:05.998136 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:05.998369 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:05.998621 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:05.998684 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:05.998747 55086 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0518 19:57:05.999061 55086 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0518 19:57:05.999334 55086 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0518 19:57:06.007316 55086 target.go:111] Terraform output is in /tmp/test353867959/out --- PASS: TestManyAddonsCCMIRSA24 (2.11s) === RUN TestManyAddonsCCMIRSA25 I0518 19:57:06.018746 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:06.018881 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:06.018931 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:06.018981 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:06.019030 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:06.019084 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:06.019132 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:06.019163 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:06.019202 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:06.019233 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:06.045901 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0518 19:57:06.049248 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:06.049328 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:07.373755 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:08.176983 55086 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0518 19:57:08.177504 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:08.177538 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:08.178520 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:08.185601 55086 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0518 19:57:08.191682 55086 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0518 19:57:08.191983 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:08.192179 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:08.192569 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:08.192921 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:08.193047 55086 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0518 19:57:08.193466 55086 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0518 19:57:08.193831 55086 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0518 19:57:08.201510 55086 target.go:111] Terraform output is in /tmp/test3891778670/out --- PASS: TestManyAddonsCCMIRSA25 (2.19s) === RUN TestManyAddonsCCMIRSA26 I0518 19:57:08.212106 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:08.212207 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:08.212247 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:08.212278 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:08.212303 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:08.212334 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:08.212361 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:08.212377 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:08.212401 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:08.212420 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:08.229037 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0518 19:57:08.231121 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:08.231172 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:09.522755 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:10.345684 55086 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0518 19:57:10.346062 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:10.346089 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:10.346152 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:10.353207 55086 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0518 19:57:10.359957 55086 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0518 19:57:10.360179 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:10.360393 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:10.360498 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:10.361035 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:10.361171 55086 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0518 19:57:10.361430 55086 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0518 19:57:10.361704 55086 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0518 19:57:10.369451 55086 target.go:111] Terraform output is in /tmp/test4197799696/out --- PASS: TestManyAddonsCCMIRSA26 (2.17s) === RUN TestManyAddonsGCE I0518 19:57:10.379993 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:57:12.709166 55086 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0518 19:57:12.709232 55086 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0518 19:57:12.709313 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W0518 19:57:12.709331 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W0518 19:57:12.709345 55086 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W0518 19:57:12.709391 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0518 19:57:12.710346 55086 executor.go:111] Tasks: 0 done / 67 total; 44 can run I0518 19:57:12.716954 55086 executor.go:111] Tasks: 44 done / 67 total; 17 can run I0518 19:57:12.723726 55086 executor.go:111] Tasks: 61 done / 67 total; 4 can run I0518 19:57:12.724892 55086 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0518 19:57:12.725072 55086 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0518 19:57:12.727646 55086 target.go:111] Terraform output is in /tmp/test2703265721/out --- PASS: TestManyAddonsGCE (2.35s) === RUN TestCCM I0518 19:57:12.733799 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:12.733932 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:12.733984 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:12.734036 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:12.734081 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:12.734136 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:12.734183 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:12.734213 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:12.734253 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:12.734285 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:12.753770 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:12.756357 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:12.756417 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:14.036523 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:14.806707 55086 executor.go:111] Tasks: 0 done / 110 total; 51 can run I0518 19:57:14.808558 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:14.808579 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:14.808639 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:14.816813 55086 executor.go:111] Tasks: 51 done / 110 total; 24 can run I0518 19:57:14.823410 55086 executor.go:111] Tasks: 75 done / 110 total; 27 can run I0518 19:57:14.823795 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:14.824070 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:14.824696 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:14.824802 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:14.824937 55086 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0518 19:57:14.825320 55086 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0518 19:57:14.825642 55086 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0518 19:57:14.831999 55086 target.go:111] Terraform output is in /tmp/test3103225591/out --- PASS: TestCCM (2.11s) === RUN TestExternalDNS I0518 19:57:14.841057 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:14.841185 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:14.841229 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:14.841280 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:14.841333 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:14.841394 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:14.841437 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:14.841467 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:14.841505 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:14.841534 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:14.869836 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:14.873228 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:14.873297 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:16.156616 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:16.308176 55086 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0518 19:57:16.309540 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:16.309563 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:16.309624 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:16.312087 55086 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0518 19:57:16.319626 55086 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0518 19:57:16.319890 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:16.320151 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:16.320331 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:16.320501 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:16.320571 55086 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0518 19:57:16.320809 55086 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0518 19:57:16.321155 55086 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0518 19:57:16.324113 55086 target.go:111] Terraform output is in /tmp/test1899779177/out --- PASS: TestExternalDNS (1.49s) === RUN TestExternalDNSIRSA I0518 19:57:16.326864 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:16.326941 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:16.326968 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:16.326995 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:16.327020 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:16.327054 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:16.327080 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:16.327098 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:16.327125 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:16.327142 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:16.344842 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:16.347602 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:16.347694 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:17.614651 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:17.811715 55086 executor.go:111] Tasks: 0 done / 112 total; 51 can run I0518 19:57:17.814447 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:17.814481 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:17.814583 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:17.818520 55086 executor.go:111] Tasks: 51 done / 112 total; 28 can run I0518 19:57:17.823574 55086 executor.go:111] Tasks: 79 done / 112 total; 25 can run I0518 19:57:17.823768 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:17.824103 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:17.824422 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:17.824813 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:17.824877 55086 executor.go:111] Tasks: 104 done / 112 total; 2 can run I0518 19:57:17.825158 55086 executor.go:111] Tasks: 106 done / 112 total; 6 can run I0518 19:57:17.825445 55086 executor.go:111] Tasks: 112 done / 112 total; 0 can run I0518 19:57:17.831424 55086 target.go:111] Terraform output is in /tmp/test481704453/out --- PASS: TestExternalDNSIRSA (1.51s) === RUN TestKarpenter I0518 19:57:17.837009 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:17.837170 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:17.837215 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:17.837266 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:17.837309 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:17.837360 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:17.837405 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:17.837435 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:17.837474 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:17.837504 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:17.868082 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:57:17.872370 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:17.872578 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:17.872803 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.442192 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:19.627101 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.627188 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.627251 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0518 19:57:19.760029 55086 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W0518 19:57:19.760129 55086 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0518 19:57:19.760148 55086 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W0518 19:57:19.760161 55086 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0518 19:57:19.760173 55086 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I0518 19:57:19.787023 55086 executor.go:111] Tasks: 0 done / 122 total; 54 can run I0518 19:57:19.787793 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:19.787820 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:19.787887 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:19.790693 55086 executor.go:111] Tasks: 54 done / 122 total; 31 can run I0518 19:57:19.800565 55086 executor.go:111] Tasks: 85 done / 122 total; 29 can run I0518 19:57:19.801056 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.801243 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.801522 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.801706 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.801782 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.801951 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.802013 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.802219 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.802301 55086 executor.go:111] Tasks: 114 done / 122 total; 2 can run I0518 19:57:19.802464 55086 executor.go:111] Tasks: 116 done / 122 total; 6 can run I0518 19:57:19.802739 55086 executor.go:111] Tasks: 122 done / 122 total; 0 can run I0518 19:57:19.810208 55086 target.go:111] Terraform output is in /tmp/test4069065624/out --- PASS: TestKarpenter (1.98s) === RUN TestSharedSubnet I0518 19:57:19.817220 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:19.817345 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:19.817389 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:19.817443 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:19.817485 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:19.817538 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:19.817582 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:19.817611 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:19.817651 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:19.817697 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:19.839340 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:19.841810 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:19.841875 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:21.384272 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:21.511446 55086 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0518 19:57:21.512679 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:21.512705 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:21.512765 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:21.514942 55086 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0518 19:57:21.515194 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:57:21.520629 55086 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0518 19:57:21.521110 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:21.521374 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:21.521856 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:21.521953 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:21.522045 55086 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0518 19:57:21.522397 55086 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0518 19:57:21.522781 55086 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0518 19:57:21.527456 55086 target.go:111] Terraform output is in /tmp/test3183925908/out --- PASS: TestSharedSubnet (1.71s) === RUN TestSharedVPC I0518 19:57:21.531992 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:21.532117 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:21.532159 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:21.532209 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:21.532251 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:21.532306 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:21.532356 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:21.532387 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:21.532430 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:21.532461 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:21.559993 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:21.563165 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:21.563259 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:23.080335 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:23.215084 55086 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0518 19:57:23.218516 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:23.218551 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:23.218621 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:23.221071 55086 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0518 19:57:23.221439 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:57:23.226771 55086 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0518 19:57:23.227234 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:23.227538 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:23.228040 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:23.228145 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:23.228228 55086 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0518 19:57:23.228567 55086 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0518 19:57:23.228809 55086 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0518 19:57:23.231248 55086 target.go:111] Terraform output is in /tmp/test1295423857/out --- PASS: TestSharedVPC (1.70s) === RUN TestSharedVPCIPv6 I0518 19:57:23.233348 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:23.233424 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:23.233447 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:23.233473 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:23.233505 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:23.233531 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:23.233554 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:23.233567 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:23.233586 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:23.233601 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:23.234620 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:57:23.234662 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:57:23.246557 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:57:23.246593 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0518 19:57:23.246643 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:57:23.248533 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:23.248591 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:24.747919 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:24.893928 55086 executor.go:111] Tasks: 0 done / 133 total; 45 can run I0518 19:57:24.895236 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:24.895286 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:24.895388 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:24.898069 55086 executor.go:111] Tasks: 45 done / 133 total; 29 can run I0518 19:57:24.898284 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:57:24.898473 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:57:24.900180 55086 executor.go:111] Tasks: 74 done / 133 total; 37 can run I0518 19:57:24.900776 55086 executor.go:111] Tasks: 111 done / 133 total; 6 can run I0518 19:57:24.900886 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:57:24.900937 55086 loadbalancers.go:35] PageSize not implemented I0518 19:57:24.900965 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:57:24.901068 55086 loadbalancers.go:35] PageSize not implemented I0518 19:57:24.904094 55086 executor.go:111] Tasks: 117 done / 133 total; 8 can run I0518 19:57:24.904201 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:24.904341 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:24.904617 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:24.904669 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:24.904716 55086 executor.go:111] Tasks: 125 done / 133 total; 2 can run I0518 19:57:24.904885 55086 executor.go:111] Tasks: 127 done / 133 total; 6 can run I0518 19:57:24.905166 55086 executor.go:111] Tasks: 133 done / 133 total; 0 can run I0518 19:57:24.915652 55086 target.go:111] Terraform output is in /tmp/test1454666134/out --- PASS: TestSharedVPCIPv6 (1.69s) === RUN TestExistingIAM I0518 19:57:24.920679 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:24.920803 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:24.920847 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:24.920901 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:24.920947 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:24.921003 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:24.921072 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:24.921106 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:24.921148 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:24.921179 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:24.953303 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:24.956599 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:24.956675 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:24.956727 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:24.956776 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:26.242801 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:26.427052 55086 executor.go:111] Tasks: 0 done / 117 total; 51 can run I0518 19:57:26.428151 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:26.428192 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:26.428291 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:26.430823 55086 executor.go:111] Tasks: 51 done / 117 total; 19 can run I0518 19:57:26.436706 55086 executor.go:111] Tasks: 70 done / 117 total; 31 can run I0518 19:57:26.437006 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:26.437251 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:26.437405 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:26.437607 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:26.437821 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:26.437925 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:26.438099 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:26.438193 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:26.438288 55086 executor.go:111] Tasks: 101 done / 117 total; 4 can run I0518 19:57:26.438729 55086 executor.go:111] Tasks: 105 done / 117 total; 12 can run I0518 19:57:26.439170 55086 executor.go:111] Tasks: 117 done / 117 total; 0 can run I0518 19:57:26.445765 55086 target.go:111] Terraform output is in /tmp/test2373498723/out --- PASS: TestExistingIAM (1.53s) === RUN TestPhaseNetwork I0518 19:57:26.450915 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:26.451065 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:26.451126 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:26.451176 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:26.451219 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:26.451270 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:26.451315 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:26.451344 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:26.451383 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:26.451412 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:26.483608 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:26.486989 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:26.487080 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:26.487138 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:27.793408 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:27.969356 55086 executor.go:111] Tasks: 0 done / 135 total; 47 can run I0518 19:57:27.970042 55086 executor.go:111] Tasks: 47 done / 135 total; 30 can run I0518 19:57:27.970597 55086 executor.go:111] Tasks: 77 done / 135 total; 36 can run I0518 19:57:27.971047 55086 executor.go:111] Tasks: 113 done / 135 total; 6 can run I0518 19:57:27.971251 55086 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0518 19:57:27.971439 55086 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0518 19:57:27.971494 55086 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0518 19:57:27.971613 55086 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0518 19:57:27.972674 55086 target.go:111] Terraform output is in /tmp/test1406758303/out --- PASS: TestPhaseNetwork (1.52s) === RUN TestExternalLoadBalancer I0518 19:57:27.973283 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:27.973439 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:27.973499 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:27.973567 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:27.973617 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:27.973698 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:27.973762 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:27.973806 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:27.973862 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:27.973897 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:28.002483 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:28.005432 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:28.005525 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:29.287599 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:29.414282 55086 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0518 19:57:29.417634 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:29.417672 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:29.417774 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:29.420293 55086 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0518 19:57:29.422857 55086 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0518 19:57:29.423142 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:29.423375 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:29.423640 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:29.424250 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:29.424451 55086 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0518 19:57:29.424832 55086 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0518 19:57:29.425172 55086 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0518 19:57:29.430152 55086 target.go:111] Terraform output is in /tmp/test660911658/out --- PASS: TestExternalLoadBalancer (1.46s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I0518 19:57:29.435129 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:29.435249 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:29.435291 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:29.435336 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:29.435373 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:29.435425 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:29.435467 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:29.435495 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:29.435536 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:29.435569 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:29.469035 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:29.470626 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:29.470670 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:29.470696 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:29.470725 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:29.470751 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:29.470770 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:29.470794 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:30.788303 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:32.422146 55086 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0518 19:57:32.422928 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:32.422984 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:32.423136 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:32.426676 55086 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0518 19:57:32.437157 55086 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0518 19:57:32.437476 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.437772 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.438091 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.438209 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.438342 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.438433 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.438606 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.439093 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.439205 55086 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0518 19:57:32.439558 55086 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0518 19:57:32.439978 55086 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0518 19:57:32.448207 55086 target.go:111] Terraform output is in /tmp/test808375413/out --- PASS: TestMixedInstancesASG (3.02s) === RUN TestMixedInstancesSpotASG I0518 19:57:32.454325 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:32.454487 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:32.454536 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:32.454590 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:32.454637 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:32.454689 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:32.454742 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:32.454772 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:32.454812 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:32.454843 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:32.477292 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:32.479579 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.479657 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.479699 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.479742 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.479777 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.479804 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:32.479830 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:33.759533 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:33.954732 55086 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0518 19:57:33.956252 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:33.956304 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:33.956413 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:33.958849 55086 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0518 19:57:33.964917 55086 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0518 19:57:33.965241 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:33.965513 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:33.967025 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:33.967260 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:33.967593 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:33.967780 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:33.968035 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:33.968237 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:33.968486 55086 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0518 19:57:33.969396 55086 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0518 19:57:33.971066 55086 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0518 19:57:33.979220 55086 target.go:111] Terraform output is in /tmp/test1129605985/out --- PASS: TestMixedInstancesSpotASG (1.53s) === RUN TestAdditionalObjects I0518 19:57:33.985203 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:33.985337 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:33.985387 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:33.985441 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:33.985486 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:33.985545 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:33.985595 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:33.985624 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:33.985664 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:33.985697 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:34.011490 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0518 19:57:34.014586 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:34.014667 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:35.316505 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:35.462129 55086 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0518 19:57:35.462687 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:35.462733 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:35.462834 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:35.465475 55086 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0518 19:57:35.468820 55086 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0518 19:57:35.469235 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:35.469550 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:35.469723 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:35.470306 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:35.470423 55086 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0518 19:57:35.470751 55086 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0518 19:57:35.471048 55086 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0518 19:57:35.475960 55086 target.go:111] Terraform output is in /tmp/test3582899918/out --- PASS: TestAdditionalObjects (1.50s) === RUN TestContainerd I0518 19:57:35.481546 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:35.481634 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:35.481666 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:35.481699 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:35.481724 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:35.481754 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:35.481782 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:35.481798 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:35.481821 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:35.481838 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:35.497882 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:35.499803 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:35.499873 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:36.845471 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:36.988989 55086 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0518 19:57:36.992197 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:36.992231 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:36.992353 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:36.996556 55086 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0518 19:57:37.002257 55086 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0518 19:57:37.002664 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:37.002896 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:37.003342 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:37.003406 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:37.003511 55086 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0518 19:57:37.003788 55086 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0518 19:57:37.004073 55086 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0518 19:57:37.009099 55086 target.go:111] Terraform output is in /tmp/test682424845/out --- PASS: TestContainerd (1.53s) === RUN TestContainerdCustom I0518 19:57:37.013646 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:37.013772 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:37.013815 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:37.013863 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:37.013901 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:37.013953 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:37.014002 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:37.014032 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:37.014071 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:37.014101 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:37.041024 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:37.043084 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:37.043142 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:37.553611 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:37.713130 55086 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0518 19:57:37.715301 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:37.715356 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:37.715493 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:37.716922 55086 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0518 19:57:37.721547 55086 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0518 19:57:37.721897 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:37.722096 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:37.722311 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:37.722771 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:37.722887 55086 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0518 19:57:37.723215 55086 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0518 19:57:37.723514 55086 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0518 19:57:37.728609 55086 target.go:111] Terraform output is in /tmp/test3786424932/out --- PASS: TestContainerdCustom (0.72s) === RUN TestDockerCustom I0518 19:57:37.733231 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:37.733360 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:37.733407 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:37.733458 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:37.733500 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:37.733554 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:37.733595 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:37.733623 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:37.733662 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:37.733697 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:37.764458 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0518 19:57:37.768650 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:37.768726 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:38.291267 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:38.415006 55086 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0518 19:57:38.416005 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:38.416032 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:38.416119 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:38.418140 55086 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0518 19:57:38.425134 55086 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0518 19:57:38.425442 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:38.425602 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:38.425829 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:38.426290 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:38.426401 55086 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0518 19:57:38.426653 55086 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0518 19:57:38.426968 55086 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0518 19:57:38.434867 55086 target.go:111] Terraform output is in /tmp/test2007741251/out --- PASS: TestDockerCustom (0.71s) === RUN TestAPIServerNodes I0518 19:57:38.439368 55086 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0518 19:57:38.439397 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:38.439523 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:38.439565 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:38.439618 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:38.439660 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:38.439711 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:38.439752 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:38.439781 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:38.439819 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:38.439847 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:38.466729 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0518 19:57:38.469986 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:38.470077 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:38.470135 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:40.035035 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:40.211422 55086 executor.go:111] Tasks: 0 done / 114 total; 47 can run I0518 19:57:40.213000 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:40.213045 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:40.213169 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:40.218616 55086 executor.go:111] Tasks: 47 done / 114 total; 28 can run I0518 19:57:40.222023 55086 executor.go:111] Tasks: 75 done / 114 total; 27 can run I0518 19:57:40.222323 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:40.222526 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:40.222794 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:40.222987 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:40.223093 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:40.223152 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:40.223207 55086 executor.go:111] Tasks: 102 done / 114 total; 3 can run I0518 19:57:40.223446 55086 executor.go:111] Tasks: 105 done / 114 total; 9 can run I0518 19:57:40.223703 55086 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0518 19:57:40.229472 55086 target.go:111] Terraform output is in /tmp/test256878926/out I0518 19:57:40.234441 55086 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (1.80s) === RUN TestNTHIMDSProcessor I0518 19:57:40.234585 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:40.234703 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:40.234749 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:40.234801 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:40.234843 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:40.234893 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:40.234938 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:40.234966 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:40.235007 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:40.235038 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:40.262285 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:40.266047 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:40.266154 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:41.567281 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:41.706056 55086 executor.go:111] Tasks: 0 done / 90 total; 44 can run I0518 19:57:41.707374 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:41.707415 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:41.707509 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:41.710892 55086 executor.go:111] Tasks: 44 done / 90 total; 19 can run I0518 19:57:41.715491 55086 executor.go:111] Tasks: 63 done / 90 total; 21 can run I0518 19:57:41.715787 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:41.715987 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:41.716139 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:41.716749 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:41.716864 55086 executor.go:111] Tasks: 84 done / 90 total; 2 can run I0518 19:57:41.717114 55086 executor.go:111] Tasks: 86 done / 90 total; 4 can run I0518 19:57:41.717349 55086 executor.go:111] Tasks: 90 done / 90 total; 0 can run I0518 19:57:41.721830 55086 target.go:111] Terraform output is in /tmp/test2957686432/out --- PASS: TestNTHIMDSProcessor (1.49s) === RUN TestNTHIMDSProcessorIRSA I0518 19:57:41.728306 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:41.728443 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:41.728501 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:41.728561 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:41.728597 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:41.728641 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:41.728696 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:41.728739 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:41.728772 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:41.728797 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:41.752631 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:41.755926 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:41.756018 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:43.029614 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:43.237592 55086 executor.go:111] Tasks: 0 done / 101 total; 50 can run I0518 19:57:43.241534 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:43.241585 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:43.241690 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:43.243255 55086 executor.go:111] Tasks: 50 done / 101 total; 24 can run I0518 19:57:43.248497 55086 executor.go:111] Tasks: 74 done / 101 total; 21 can run I0518 19:57:43.248755 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:43.249063 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:43.249551 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:43.249658 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:43.249747 55086 executor.go:111] Tasks: 95 done / 101 total; 2 can run I0518 19:57:43.250094 55086 executor.go:111] Tasks: 97 done / 101 total; 4 can run I0518 19:57:43.250375 55086 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0518 19:57:43.256100 55086 target.go:111] Terraform output is in /tmp/test974742865/out --- PASS: TestNTHIMDSProcessorIRSA (1.53s) === RUN TestCustomIRSA I0518 19:57:43.261224 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:43.261354 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:43.261399 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:43.261447 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:43.261487 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:43.261541 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:43.261586 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:43.261614 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:43.261653 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:43.261681 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:43.289107 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:43.291532 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:43.291591 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:44.594553 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:45.200750 55086 executor.go:111] Tasks: 0 done / 114 total; 52 can run I0518 19:57:45.202796 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:45.202815 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:45.202867 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:45.208316 55086 executor.go:111] Tasks: 52 done / 114 total; 29 can run I0518 19:57:45.216362 55086 executor.go:111] Tasks: 81 done / 114 total; 25 can run I0518 19:57:45.216756 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:45.217054 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:45.217240 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:45.217843 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:45.217957 55086 executor.go:111] Tasks: 106 done / 114 total; 2 can run I0518 19:57:45.218272 55086 executor.go:111] Tasks: 108 done / 114 total; 6 can run I0518 19:57:45.218606 55086 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0518 19:57:45.223305 55086 target.go:111] Terraform output is in /tmp/test480607531/out --- PASS: TestCustomIRSA (1.97s) === RUN TestClusterNameDigit I0518 19:57:45.230250 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:45.230354 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:45.230395 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:45.230437 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:45.230470 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:45.230514 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:45.230548 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:45.230572 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:45.230606 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:45.230629 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:45.247806 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:57:45.249742 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:45.249796 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:46.533431 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:46.707783 55086 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0518 19:57:46.710315 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:46.710367 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:46.710494 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:46.712268 55086 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0518 19:57:46.718331 55086 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0518 19:57:46.718884 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:46.719131 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:46.719440 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:46.719801 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:46.719925 55086 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0518 19:57:46.720332 55086 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0518 19:57:46.720690 55086 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0518 19:57:46.726229 55086 target.go:111] Terraform output is in /tmp/test426762411/out --- PASS: TestClusterNameDigit (1.50s) === RUN TestCASPriorityExpander I0518 19:57:46.734381 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:46.734534 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:46.734581 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:46.734633 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:46.734679 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:46.734733 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:46.734780 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:46.734809 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:46.734846 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:46.734876 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:46.765950 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0518 19:57:46.770077 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:46.770169 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:46.770229 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:46.770283 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0518 19:57:48.737724 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:48.933608 55086 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0518 19:57:48.934908 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:48.934940 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:48.935008 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:48.938005 55086 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0518 19:57:48.943563 55086 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0518 19:57:48.943943 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:48.944036 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:48.944246 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:48.944375 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:48.944524 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:48.944671 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:48.944780 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:48.944958 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:48.945084 55086 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0518 19:57:48.945447 55086 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0518 19:57:48.945981 55086 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0518 19:57:48.952228 55086 target.go:111] Terraform output is in /tmp/test2116850687/out --- PASS: TestCASPriorityExpander (2.22s) === RUN TestCASPriorityExpanderCustom I0518 19:57:48.957543 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:48.957694 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:48.957770 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:48.957822 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:48.957865 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:48.957918 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:48.957965 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:48.957995 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:48.958038 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:48.958067 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:57:48.993316 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0518 19:57:48.997875 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:48.997971 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:48.998030 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:48.998082 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0518 19:57:50.282923 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:50.425683 55086 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0518 19:57:50.429027 55086 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0518 19:57:50.429062 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:50.429148 55086 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0518 19:57:50.432894 55086 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0518 19:57:50.436271 55086 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0518 19:57:50.436569 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:50.436751 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:50.436917 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:50.437155 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:50.437206 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:50.437330 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:50.437433 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:50.437727 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:50.437851 55086 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0518 19:57:50.438132 55086 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0518 19:57:50.438486 55086 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0518 19:57:50.444880 55086 target.go:111] Terraform output is in /tmp/test261069405/out --- PASS: TestCASPriorityExpanderCustom (1.49s) === RUN TestLifecycleMinimalAWS I0518 19:57:50.450175 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:57:50.450304 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:57:50.450348 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:57:50.450396 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:57:50.450440 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:57:50.450491 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:57:50.450535 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:57:50.450564 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:57:50.450605 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:57:50.450634 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0518 19:57:50.467923 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0518 19:57:50.469914 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:50.469983 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0518 19:57:51.810834 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:51.990608 55086 iamrole.go:89] ListRoles: { } I0518 19:57:51.992112 55086 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0518 19:57:51.992499 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:51.992651 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:51.992884 55086 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:57:51.993003 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:51.993208 55086 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0518 19:57:51.993299 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:57:51.993351 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0518 19:57:51.993407 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0518 19:57:51.993428 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:57:51.993455 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:57:51.993490 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:57:51.993569 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0518 19:57:51.993617 55086 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I0518 19:57:51.993663 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0518 19:57:51.993744 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:51.993904 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:57:51.994011 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:57:51.994062 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:51.994175 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:57:51.994276 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:57:51.994437 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0518 19:57:51.994573 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0518 19:57:51.996061 55086 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0518 19:57:51.996223 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:51.996346 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0518 19:57:51.996386 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0518 19:57:51.996482 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0518 19:57:51.996493 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" } ] }], VpcId: "vpc-1" } I0518 19:57:51.996571 55086 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0518 19:57:51.996411 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0518 19:57:51.996761 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0518 19:57:51.996734 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I0518 19:57:51.996891 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" } ] }], VpcId: "vpc-1" } I0518 19:57:51.996906 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:57:51.996936 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0518 19:57:51.997072 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:51.997213 55086 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0518 19:57:51.997272 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:57:51.997301 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:57:51.997398 55086 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0518 19:57:51.997437 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0518 19:57:51.997557 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0518 19:57:51.997620 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:57:51.997650 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:57:51.997698 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:57:51.997731 55086 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0518 19:57:51.997791 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0518 19:57:51.997841 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:57:51.997871 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:57:51.997904 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:57:51.997933 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:57:51.997958 55086 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0518 19:57:51.998477 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0518 19:57:52.001823 55086 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0518 19:57:52.002098 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:57:52.002275 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:57:52.002399 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0518 19:57:52.002427 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0518 19:57:52.002500 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0518 19:57:52.002590 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:57:52.002678 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:57:52.002822 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:52.002887 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:52.002967 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:57:52.003103 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0518 19:57:52.003169 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:57:52.003229 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:57:52.003312 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:57:52.003393 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:57:52.003468 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:52.003524 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:52.003632 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I0518 19:57:52.003842 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0518 19:57:52.003913 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:57:52.004064 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0518 19:57:52.004197 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:57:52.004333 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" }] }] } I0518 19:57:52.004490 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:57:52.004642 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:57:52.004860 55086 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0518 19:57:52.005193 55086 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0518 19:57:52.005451 55086 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0518 19:57:52.005515 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:52.005560 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:57:52.005644 55086 dns.go:235] Pre-creating DNS records I0518 19:57:52.005676 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:57:52.011387 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0518 19:57:52.014428 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:52.014522 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0518 19:57:53.350552 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:53.526088 55086 iamrole.go:89] ListRoles: { } I0518 19:57:53.527468 55086 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0518 19:57:53.527864 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.528352 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] }] } I0518 19:57:53.528538 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.528538 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:57:53.528945 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.529041 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:57:53.529076 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:57:53.529115 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:57:53.529273 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:57:53.531194 55086 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0518 19:57:53.531489 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0518 19:57:53.531582 55086 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0518 19:57:53.531581 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0518 19:57:53.531791 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:57:53.531882 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0518 19:57:53.532035 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:57:53.532092 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:57:53.532235 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:57:53.532334 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.532472 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I0518 19:57:53.532610 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:57:53.532656 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.537989 55086 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0518 19:57:53.538173 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:53.538488 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:53.538761 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:57:53.538906 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:57:53.539146 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:53.539300 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:57:53.539356 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:57:53.540107 55086 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0518 19:57:53.540336 55086 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0518 19:57:53.540596 55086 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0518 19:57:53.543231 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0518 19:57:53.543296 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:57:53.543338 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0518 19:57:53.543371 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:57:53.543403 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0518 19:57:53.543432 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0518 19:57:53.543463 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:57:53.543494 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0518 19:57:53.543526 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0518 19:57:53.543564 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0518 19:57:53.543599 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:57:53.543627 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:57:53.543656 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:57:53.543691 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0518 19:57:53.543723 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:57:53.543755 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:57:53.543788 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:57:53.543824 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:57:53.543855 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:57:53.543884 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0518 19:57:53.543916 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:57:53.543952 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:57:53.543987 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:57:53.544019 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0518 19:57:53.545303 55086 delete_cluster.go:128] Looking for cloud resources to delete W0518 19:57:53.545417 55086 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0518 19:57:53.545442 55086 keypairs.go:95] DescribeKeyPairs: { } I0518 19:57:53.545484 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.545532 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0518 19:57:53.545601 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.545660 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.545706 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.545760 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.545804 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.545840 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0518 19:57:53.545885 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.545937 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:57:53.545975 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0518 19:57:53.546017 55086 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0518 19:57:53.546055 55086 api.go:53] PageSize not implemented I0518 19:57:53.546081 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:57:53.546112 55086 loadbalancers.go:35] PageSize not implemented I0518 19:57:53.546133 55086 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0518 19:57:53.546165 55086 targetgroups.go:35] PageSize not implemented I0518 19:57:53.546187 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0518 19:57:53.546246 55086 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0518 19:57:53.546294 55086 iamrole.go:89] ListRoles: { } I0518 19:57:53.546341 55086 zones.go:93] ListHostedZonesPages { } I0518 19:57:53.546375 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:57:53.546419 55086 internetgateways.go:101] DescribeInternetGateways: { } I0518 19:57:53.546465 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:57:53.546499 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0518 19:57:53.547097 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0518 19:57:53.547154 55086 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } autoscaling-group:nodes.minimal.example.com ok I0518 19:57:53.547206 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0518 19:57:53.547234 55086 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0518 19:57:53.547272 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0518 19:57:53.547312 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:57:53.547351 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0518 19:57:53.547277 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:57:53.547374 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.minimal.example.com. ok W0518 19:57:53.547555 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:57:53.547586 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0518 19:57:53.547627 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:57:53.547701 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0518 19:57:53.547908 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:57:53.547930 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0518 19:57:53.547975 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0518 19:57:53.548041 55086 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0518 19:57:53.548116 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0518 19:57:53.548209 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0518 19:57:53.548262 55086 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0518 19:57:53.548279 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0518 19:57:53.548249 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0518 19:57:53.548320 55086 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0518 19:57:53.548359 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0518 19:57:53.548399 55086 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0518 19:57:53.548413 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0518 19:57:53.548440 55086 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0518 19:57:53.548505 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0518 19:57:53.548594 55086 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0518 19:57:53.548678 55086 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (3.10s) === RUN TestLifecycleMinimalOpenstack I0518 19:57:53.549167 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I0518 19:57:53.557029 55086 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:57:55.015281 55086 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0518 19:57:55.015334 55086 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0518 19:57:55.033145 55086 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2024/05/18 19:57:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:57:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0518 19:57:55.038001 55086 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0518 19:57:55.052178 55086 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0518 19:57:55.056083 55086 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2024/05/18 19:57:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:57:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:57:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0518 19:57:55.058939 55086 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0518 19:57:55.059179 55086 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0518 19:57:55.059208 55086 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0518 19:57:56.064310 55086 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:57:57.476708 55086 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0518 19:57:57.476759 55086 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0518 19:57:57.497237 55086 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2024/05/18 19:57:57 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:57:57 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0518 19:57:57.506002 55086 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0518 19:57:57.512888 55086 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0518 19:57:57.514500 55086 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2024/05/18 19:57:57 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:57:57 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:57:57 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0518 19:57:57.516611 55086 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0518 19:57:57.517037 55086 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0518 19:57:57.517744 55086 executor.go:111] Tasks: 92 done / 92 total; 0 can run I0518 19:57:57.519154 55086 delete_cluster.go:128] Looking for cloud resources to delete 2024/05/18 19:57:57 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Port:fb838620-8c92-47c1-894d-89c2ec8c91d9 ok Subnet:27da2f20-a0c7-4fad-8d24-a02e56078758 ok Port:d798bccc-de24-4550-b484-21d71ae1927e ok ServerGroup:772e6783-2115-45cf-bd73-0898545fe2ab ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok ServerGroup:faf8f427-c534-405e-a199-f95b849a258f ok Port:715c7af7-4ca4-4a8a-9842-c6f97cbff52a ok Network:7e1c3851-707c-4422-b89f-9ffeba8c4f44 ok Instance:5d2a2704-4e96-4dfb-a7dd-c385ce56534f ok Instance:f7eb89d5-ea34-4be9-94e5-b9461478596f ok SecurityGroup:99622b74-aa8c-4a75-b925-f2dc40d9dd8a ok SecurityGroup:8cc41474-1600-4cb1-9be0-83513f93d974 ok SecurityGroup:ebdda639-2293-4dde-a945-946154c8c4c4 ok Instance:12b08a97-c22b-4886-a198-a0456a70bdad ok --- PASS: TestLifecycleMinimalOpenstack (5.08s) === RUN TestLifecycleMinimalGCE I0518 19:57:58.631499 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I0518 19:57:58.633381 55086 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:58:00.344861 55086 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0518 19:58:00.344939 55086 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0518 19:58:00.345036 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0518 19:58:00.345057 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0518 19:58:00.345076 55086 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0518 19:58:00.345136 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0518 19:58:00.346290 55086 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0518 19:58:00.352808 55086 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0518 19:58:00.359108 55086 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0518 19:58:00.359979 55086 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0518 19:58:00.360195 55086 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0518 19:58:00.360288 55086 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:58:02.015957 55086 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0518 19:58:02.016064 55086 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0518 19:58:02.016191 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0518 19:58:02.016220 55086 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0518 19:58:02.016245 55086 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0518 19:58:02.016337 55086 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0518 19:58:02.017781 55086 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0518 19:58:02.022115 55086 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0518 19:58:02.027967 55086 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0518 19:58:02.029406 55086 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0518 19:58:02.029578 55086 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0518 19:58:02.031199 55086 delete_cluster.go:128] Looking for cloud resources to delete I0518 19:58:02.031265 55086 gce.go:99] Scanning zones: [us-test1-a] I0518 19:58:02.031658 55086 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I0518 19:58:02.031682 55086 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:master-to-master-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1716062280 ok InstanceTemplate:nodes-minimal-gce-example-com-1716062280 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (3.40s) === RUN TestLifecycleFloatingIPOpenstack I0518 19:58:02.033155 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I0518 19:58:02.041745 55086 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:58:03.508414 55086 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0518 19:58:03.508458 55086 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0518 19:58:03.526446 55086 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2024/05/18 19:58:03 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:58:03 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0518 19:58:03.531459 55086 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0518 19:58:03.541637 55086 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0518 19:58:03.544719 55086 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2024/05/18 19:58:03 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:58:03 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:58:03 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0518 19:58:03.546500 55086 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0518 19:58:03.546718 55086 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0518 19:58:03.547319 55086 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0518 19:58:04.550898 55086 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0518 19:58:05.995723 55086 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0518 19:58:05.995757 55086 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0518 19:58:06.008788 55086 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2024/05/18 19:58:06 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:58:06 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0518 19:58:06.013130 55086 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0518 19:58:06.022635 55086 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0518 19:58:06.024772 55086 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2024/05/18 19:58:06 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:58:06 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/05/18 19:58:06 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0518 19:58:06.027483 55086 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0518 19:58:06.027784 55086 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0518 19:58:06.028407 55086 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0518 19:58:06.029774 55086 delete_cluster.go:128] Looking for cloud resources to delete 2024/05/18 19:58:06 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) SecurityGroup:b326c97d-0d8b-4710-b559-b6c62522e5f7 ok Instance:d34a8213-bd3f-4ff5-808c-b52674561bc7 ok Router-IF:7426cd08-909a-4967-a83e-27e892399e11 ok Subnet:7426cd08-909a-4967-a83e-27e892399e11 ok Router:73929403-e6df-4f08-923b-6c476b29e12e ok Port:c19190c0-ab9f-4da3-8398-ac1f88dfae39 ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok SecurityGroup:3074797a-1538-4e13-a871-21cf3f931761 ok Instance:ce038cd5-9b76-419c-a421-d86edc2b953c ok Network:af4abf71-65c2-43da-a926-7a28ca1ef52f ok Instance:d8cc1531-8de4-4685-a697-f1cfb5f45ed0 ok Port:e5a54031-56b4-42eb-b2be-908e0f295409 ok ServerGroup:8fdcdc6e-1dd7-401d-8a7b-158b8630e99e ok SecurityGroup:45cbd2f7-9ef8-44cb-861f-7e5672b31079 ok ServerGroup:1776d8d2-612c-4b19-a4fc-9a72c1d9178c ok Port:3a78f563-20da-456d-b9f3-b8a55a2f723c ok Port:628600ae-646c-4555-96d2-b8d987f4eb1a ok --- PASS: TestLifecycleFloatingIPOpenstack (5.10s) === RUN TestLifecyclePrivateCalico I0518 19:58:07.132186 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:58:07.132348 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:58:07.132400 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:58:07.132451 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:58:07.132495 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:58:07.132548 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:58:07.132595 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:58:07.132629 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:58:07.132673 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:58:07.132703 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I0518 19:58:07.161653 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:58:07.165394 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:07.165483 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:07.165550 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:08.497988 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:08.924426 55086 iamrole.go:89] ListRoles: { } I0518 19:58:08.925917 55086 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0518 19:58:08.926134 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I0518 19:58:08.926205 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0518 19:58:08.926293 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I0518 19:58:08.926416 55086 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.926409 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:08.926451 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0518 19:58:08.926511 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] } I0518 19:58:08.926538 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:08.926660 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:08.926680 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:08.926755 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:08.926760 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0518 19:58:08.926793 55086 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.926854 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0518 19:58:08.926915 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0518 19:58:08.926941 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0518 19:58:08.926964 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:58:08.926995 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:08.927090 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:08.927247 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:08.927355 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:08.927391 55086 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.927455 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:08.927495 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:08.930173 55086 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0518 19:58:08.930605 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:08.930714 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0518 19:58:08.930748 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:08.930874 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0518 19:58:08.930906 55086 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0518 19:58:08.931048 55086 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0518 19:58:08.931266 55086 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0518 19:58:08.931107 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:08.931424 55086 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0518 19:58:08.931286 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0518 19:58:08.931638 55086 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.931753 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0518 19:58:08.932536 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0518 19:58:08.931764 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:08.931734 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I0518 19:58:08.932661 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0518 19:58:08.932639 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0518 19:58:08.932773 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0518 19:58:08.932828 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0518 19:58:08.932920 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0518 19:58:08.932873 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:08.932992 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:08.933140 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0518 19:58:08.933099 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], VpcId: "vpc-1" } I0518 19:58:08.933111 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0518 19:58:08.933889 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0518 19:58:08.934009 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0518 19:58:08.934110 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:08.934203 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:08.934255 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0518 19:58:08.934417 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:08.934482 55086 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0518 19:58:08.934570 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.privatecalico.example.com" }] }], VpcId: "vpc-1" } I0518 19:58:08.934664 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:08.934719 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:08.934767 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0518 19:58:08.934853 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:08.934897 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:08.934948 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0518 19:58:08.935033 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:08.935076 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:08.935122 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }], VpcId: "vpc-1" } I0518 19:58:08.935207 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0518 19:58:08.935256 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:08.935298 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0518 19:58:08.935343 55086 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0518 19:58:08.935398 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:08.935464 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:08.935552 55086 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0518 19:58:08.935639 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:08.935371 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0518 19:58:08.935719 55086 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" } ] } I0518 19:58:08.935904 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:08.936073 55086 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0518 19:58:08.936367 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:08.936497 55086 api.go:53] PageSize not implemented I0518 19:58:08.936459 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0518 19:58:08.936505 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:08.936643 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0518 19:58:08.936723 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0518 19:58:08.936671 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:08.936759 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.936833 55086 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0518 19:58:08.936958 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:08.937000 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:08.936825 55086 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I0518 19:58:08.937053 55086 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0518 19:58:08.937081 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:08.937118 55086 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0518 19:58:08.937135 55086 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } W0518 19:58:08.937198 55086 api.go:53] PageSize not implemented I0518 19:58:08.937145 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.937230 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:08.937269 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0518 19:58:08.937312 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.937464 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.937549 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0518 19:58:08.937611 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0518 19:58:08.937693 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:08.937878 55086 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.937793 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.938037 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:08.938146 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.938298 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:08.938395 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0518 19:58:08.938513 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0518 19:58:08.938645 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" }] }] } I0518 19:58:08.938770 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.938883 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.939005 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.939124 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0518 19:58:08.939208 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0518 19:58:08.939310 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.939421 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.939522 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" }] }] } I0518 19:58:08.939635 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.939728 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.939821 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0518 19:58:08.939856 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0518 19:58:08.939887 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0518 19:58:08.939977 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.940070 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0518 19:58:08.940142 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.940234 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:08.940310 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:08.940377 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" }] }] } I0518 19:58:08.940481 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.940587 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.940691 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0518 19:58:08.940726 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.940872 55086 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0518 19:58:08.940954 55086 api.go:53] PageSize not implemented I0518 19:58:08.940993 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:08.940990 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:08.941067 55086 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } W0518 19:58:08.941111 55086 api.go:53] PageSize not implemented I0518 19:58:08.941139 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:08.940994 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:08.941217 55086 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0518 19:58:08.941321 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0518 19:58:08.941351 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:08.941313 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:08.941377 55086 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0518 19:58:08.941414 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:08.941488 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:08.944436 55086 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0518 19:58:08.944638 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:08.944800 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0518 19:58:08.944942 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:08.945053 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:08.945290 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:08.945414 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:08.946122 55086 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0518 19:58:08.946437 55086 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0518 19:58:08.946691 55086 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0518 19:58:08.946739 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:08.946783 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:08.946852 55086 dns.go:235] Pre-creating DNS records I0518 19:58:08.946881 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:08.954203 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:58:08.957841 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:08.957930 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:08.957995 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:10.267215 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:10.643452 55086 iamrole.go:89] ListRoles: { } I0518 19:58:10.645368 55086 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0518 19:58:10.645838 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:10.645871 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.646081 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:10.646139 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:10.646213 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:10.646618 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.646844 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.647051 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.648027 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:10.649633 55086 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0518 19:58:10.649856 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0518 19:58:10.649807 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.649965 55086 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0518 19:58:10.650000 55086 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0518 19:58:10.649938 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0518 19:58:10.650126 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:10.650120 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0518 19:58:10.650202 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0518 19:58:10.650236 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0518 19:58:10.650189 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0518 19:58:10.650339 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:10.650387 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0518 19:58:10.650578 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:10.650643 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:10.650739 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.650882 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:10.650933 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:10.651028 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.651189 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.651331 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.651462 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:10.651555 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0518 19:58:10.651721 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:10.651883 55086 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0518 19:58:10.652003 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:10.652072 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:10.652037 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:10.652093 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } W0518 19:58:10.652145 55086 api.go:53] PageSize not implemented I0518 19:58:10.652192 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:10.652180 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:10.652137 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0518 19:58:10.652277 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:10.652295 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:10.652322 55086 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0518 19:58:10.652352 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0518 19:58:10.652386 55086 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0518 19:58:10.652295 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0518 19:58:10.652411 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0518 19:58:10.652445 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0518 19:58:10.652496 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0518 19:58:10.652538 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0518 19:58:10.652590 55086 api.go:53] PageSize not implemented I0518 19:58:10.652612 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:10.652705 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:10.652770 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:10.652835 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:10.652975 55086 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0518 19:58:10.653019 55086 api.go:53] PageSize not implemented I0518 19:58:10.653043 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:10.653074 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:10.653059 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:10.653128 55086 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0518 19:58:10.653146 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0518 19:58:10.653152 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } W0518 19:58:10.653250 55086 api.go:53] PageSize not implemented I0518 19:58:10.653246 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:10.653288 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:10.653314 55086 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0518 19:58:10.653343 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:10.661426 55086 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0518 19:58:10.661614 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:10.661830 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:10.662119 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:10.662525 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:10.662598 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:10.663325 55086 executor.go:111] Tasks: 134 done / 142 total; 2 can run W0518 19:58:10.663454 55086 api.go:53] PageSize not implemented I0518 19:58:10.663478 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:10.663683 55086 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0518 19:58:10.663988 55086 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0518 19:58:10.667829 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0518 19:58:10.667896 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:10.667938 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0518 19:58:10.667973 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0518 19:58:10.668006 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:10.668036 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0518 19:58:10.668071 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0518 19:58:10.668104 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:10.668138 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0518 19:58:10.668174 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0518 19:58:10.668211 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0518 19:58:10.668257 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0518 19:58:10.668295 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0518 19:58:10.668328 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:58:10.668360 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:58:10.668392 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:10.668424 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0518 19:58:10.668455 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0518 19:58:10.668490 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:10.668525 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:10.668559 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:10.668594 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0518 19:58:10.668627 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:10.668662 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:10.668693 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:10.668730 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:58:10.668767 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0518 19:58:10.668798 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:10.668834 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:10.668871 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:58:10.668903 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0518 19:58:10.670434 55086 delete_cluster.go:128] Looking for cloud resources to delete W0518 19:58:10.670508 55086 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0518 19:58:10.670531 55086 keypairs.go:95] DescribeKeyPairs: { } I0518 19:58:10.670573 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.670634 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0518 19:58:10.670705 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.670771 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.670823 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.670875 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.670918 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.670961 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0518 19:58:10.671038 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.671095 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:10.671125 55086 natgateway.go:117] DescribeNatGateways: { } I0518 19:58:10.671162 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0518 19:58:10.671203 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W0518 19:58:10.671261 55086 api.go:53] PageSize not implemented I0518 19:58:10.671280 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0518 19:58:10.671323 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:10.671350 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:10.671368 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0518 19:58:10.671407 55086 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0518 19:58:10.671432 55086 targetgroups.go:35] PageSize not implemented I0518 19:58:10.671451 55086 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" ] } I0518 19:58:10.671515 55086 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0518 19:58:10.671558 55086 iamrole.go:89] ListRoles: { } I0518 19:58:10.671610 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:10.671640 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:10.671685 55086 internetgateways.go:101] DescribeInternetGateways: { } I0518 19:58:10.671736 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:10.671779 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0518 19:58:10.671817 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0518 19:58:10.671854 55086 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0518 19:58:10.672463 55086 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0518 19:58:10.672512 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0518 19:58:10.672606 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0518 19:58:10.672621 55086 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0518 19:58:10.672648 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } autoscaling-group:nodes.privatecalico.example.com ok I0518 19:58:10.672574 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } I0518 19:58:10.672553 55086 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } load-balancer:api-privatecalico-example-0uch4k ok I0518 19:58:10.672702 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I0518 19:58:10.672739 55086 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-group:bastion.privatecalico.example.com ok autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok autoscaling-config:lt-2 ok iam-instance-profile:bastions.privatecalico.example.com ok volume:vol-2 ok autoscaling-config:lt-1 ok autoscaling-config:lt-3 ok I0518 19:58:10.672761 55086 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I0518 19:58:10.672801 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0518 19:58:10.672676 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.privatecalico.example.com. ok I0518 19:58:10.672852 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:10.672892 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } iam-instance-profile:nodes.privatecalico.example.com ok I0518 19:58:10.672949 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0518 19:58:10.673089 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:10.673119 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0518 19:58:10.673159 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:10.673209 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0518 19:58:10.673415 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:10.673438 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0518 19:58:10.673473 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:10.673526 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0518 19:58:10.673704 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:10.673725 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0518 19:58:10.673768 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0518 19:58:10.673827 55086 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0518 19:58:10.673888 55086 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0518 19:58:10.673991 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I0518 19:58:10.674041 55086 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I0518 19:58:10.674016 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0518 19:58:10.674059 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0518 19:58:10.674102 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:10.674135 55086 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I0518 19:58:10.674200 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I0518 19:58:10.674259 55086 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I0518 19:58:10.674155 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W0518 19:58:10.674287 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:10.674277 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0518 19:58:10.674311 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0518 19:58:10.674314 55086 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I0518 19:58:10.674367 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0518 19:58:10.674400 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I0518 19:58:10.674448 55086 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I0518 19:58:10.674465 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0518 19:58:10.674452 55086 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0518 19:58:10.674495 55086 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I0518 19:58:10.674571 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0518 19:58:10.674660 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0518 19:58:10.674798 55086 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0518 19:58:10.674889 55086 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (3.54s) === RUN TestLifecyclePrivateKopeio I0518 19:58:10.675371 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:58:10.675507 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:58:10.675546 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:58:10.675588 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:58:10.675630 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:58:10.675679 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:58:10.675720 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:58:10.675751 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:58:10.675790 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:58:10.675819 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I0518 19:58:10.704068 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:10.707812 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:10.707898 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:10.707960 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:11.777031 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:11.965357 55086 iamrole.go:89] ListRoles: { } I0518 19:58:11.967521 55086 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0518 19:58:11.967783 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.968067 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:11.968208 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0518 19:58:11.968260 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:11.968299 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] } I0518 19:58:11.968338 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.968456 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0518 19:58:11.968508 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0518 19:58:11.968495 55086 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0518 19:58:11.968459 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:11.968570 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0518 19:58:11.968596 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0518 19:58:11.968619 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:58:11.968651 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:11.968679 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:11.968780 55086 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.968890 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.968989 55086 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.969052 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:11.969007 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0518 19:58:11.969082 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.969152 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0518 19:58:11.969277 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:11.969372 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:11.971507 55086 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0518 19:58:11.971659 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0518 19:58:11.971705 55086 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0518 19:58:11.971691 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:11.971776 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0518 19:58:11.971879 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0518 19:58:11.971659 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0518 19:58:11.971989 55086 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0518 19:58:11.971916 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.972035 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0518 19:58:11.972069 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0518 19:58:11.972092 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.972162 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0518 19:58:11.972084 55086 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0518 19:58:11.972160 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0518 19:58:11.972205 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0518 19:58:11.972206 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0518 19:58:11.972251 55086 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0518 19:58:11.972261 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.972274 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0518 19:58:11.972332 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0518 19:58:11.972376 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:11.972431 55086 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.972528 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:11.972584 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0518 19:58:11.972628 55086 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I0518 19:58:11.972704 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0518 19:58:11.972895 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0518 19:58:11.972995 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.973100 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.973191 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0518 19:58:11.973312 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:11.973295 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0518 19:58:11.973389 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.973287 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0518 19:58:11.973477 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.973544 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0518 19:58:11.973560 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0518 19:58:11.973651 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0518 19:58:11.973664 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I0518 19:58:11.973756 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:11.973849 55086 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0518 19:58:11.973926 55086 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0518 19:58:11.973972 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:11.973929 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0518 19:58:11.974033 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:11.974090 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0518 19:58:11.974140 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0518 19:58:11.974312 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:11.974281 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0518 19:58:11.974419 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:11.974510 55086 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0518 19:58:11.974601 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:11.974658 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:11.974700 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:11.974752 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:11.974806 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0518 19:58:11.974850 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:11.974886 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }], VpcId: "vpc-1" } I0518 19:58:11.974981 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:11.975035 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:11.975086 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0518 19:58:11.975130 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0518 19:58:11.975215 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0518 19:58:11.975271 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:11.975319 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0518 19:58:11.975365 55086 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0518 19:58:11.975487 55086 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0518 19:58:11.975617 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:11.975730 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0518 19:58:11.975821 55086 api.go:53] PageSize not implemented I0518 19:58:11.975825 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0518 19:58:11.975869 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:11.975997 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:11.975967 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:11.975922 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:11.976106 55086 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] } I0518 19:58:11.976158 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:11.976181 55086 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0518 19:58:11.976138 55086 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-1" },{ SubnetId: "subnet-3" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I0518 19:58:11.976181 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0518 19:58:11.976219 55086 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0518 19:58:11.976270 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0518 19:58:11.976329 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:11.976385 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.976589 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.976727 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" }] }] } I0518 19:58:11.976922 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.977126 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" }] }] } I0518 19:58:11.977305 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0518 19:58:11.977449 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I0518 19:58:11.977541 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.977757 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:11.977857 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0518 19:58:11.977903 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.978152 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.978354 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" }] }] } I0518 19:58:11.978444 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:11.978524 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0518 19:58:11.978597 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:11.978636 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0518 19:58:11.978725 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:58:11.978779 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:11.978828 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" }] }] } I0518 19:58:11.978895 55086 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W0518 19:58:11.979013 55086 api.go:53] PageSize not implemented I0518 19:58:11.979038 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:11.978980 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" }] }] } I0518 19:58:11.979132 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.979283 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0518 19:58:11.979316 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:11.979378 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.979458 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0518 19:58:11.979486 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.979640 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } I0518 19:58:11.979769 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0518 19:58:11.979871 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0518 19:58:11.980006 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I0518 19:58:11.980145 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" }] }] } I0518 19:58:11.980215 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0518 19:58:11.980304 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0518 19:58:11.980329 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0518 19:58:11.980385 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" }] }] } I0518 19:58:11.980470 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0518 19:58:11.980496 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:58:11.980526 55086 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0518 19:58:11.980593 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:11.980649 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-2" } I0518 19:58:11.980699 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0518 19:58:11.980803 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I0518 19:58:11.980854 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0518 19:58:11.980897 55086 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0518 19:58:11.980949 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0518 19:58:11.980994 55086 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0518 19:58:11.981080 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0518 19:58:11.981109 55086 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0518 19:58:11.981167 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:11.981245 55086 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0518 19:58:11.981289 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:11.981331 55086 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0518 19:58:11.981506 55086 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0518 19:58:11.981588 55086 api.go:53] PageSize not implemented I0518 19:58:11.981625 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:11.981630 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:11.981626 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W0518 19:58:11.981684 55086 api.go:53] PageSize not implemented I0518 19:58:11.981771 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:11.981836 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:11.981734 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:11.981902 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:11.981942 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-1" } I0518 19:58:11.982003 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-3" } I0518 19:58:11.981972 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:11.985967 55086 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0518 19:58:11.986183 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:11.986309 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:11.986481 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:11.986609 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:11.987071 55086 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0518 19:58:11.987388 55086 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0518 19:58:11.987688 55086 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0518 19:58:11.987742 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:11.987781 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:11.987847 55086 dns.go:235] Pre-creating DNS records I0518 19:58:11.987874 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:11.994307 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:11.997801 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:11.997891 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:11.997956 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:13.301353 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:13.469957 55086 iamrole.go:89] ListRoles: { } I0518 19:58:13.472375 55086 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0518 19:58:13.473096 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] }] } I0518 19:58:13.473776 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.473917 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.474036 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:13.474061 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:13.474094 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:13.474785 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.475005 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:13.475545 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:13.476926 55086 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0518 19:58:13.477142 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0518 19:58:13.477080 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.477229 55086 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0518 19:58:13.477173 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0518 19:58:13.477287 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0518 19:58:13.477265 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0518 19:58:13.477326 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0518 19:58:13.477362 55086 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0518 19:58:13.477371 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:13.477409 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:13.477439 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.477536 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:13.477561 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0518 19:58:13.477641 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:13.477684 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.477780 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0518 19:58:13.477875 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:13.477908 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0518 19:58:13.477987 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:13.478021 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.478097 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:13.478126 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:13.478177 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:13.478227 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.478302 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.478369 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.478438 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0518 19:58:13.478463 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.478856 55086 executor.go:111] Tasks: 81 done / 144 total; 41 can run W0518 19:58:13.478985 55086 api.go:53] PageSize not implemented I0518 19:58:13.479003 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:13.479052 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:13.479085 55086 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0518 19:58:13.479177 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:13.479215 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:13.479316 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:13.479342 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0518 19:58:13.479317 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:13.479396 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0518 19:58:13.479431 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0518 19:58:13.479456 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0518 19:58:13.479480 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } W0518 19:58:13.479532 55086 api.go:53] PageSize not implemented I0518 19:58:13.479499 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:13.479544 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:13.479590 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:13.479712 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:13.479784 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:13.479907 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0518 19:58:13.480082 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:13.480205 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0518 19:58:13.480331 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:13.480620 55086 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0518 19:58:13.480690 55086 api.go:53] PageSize not implemented I0518 19:58:13.480739 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:13.480823 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:13.480878 55086 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0518 19:58:13.480860 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:13.480897 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0518 19:58:13.480898 55086 api.go:53] PageSize not implemented I0518 19:58:13.480946 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:13.480941 55086 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0518 19:58:13.481048 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:13.481208 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:13.481299 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:13.486076 55086 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0518 19:58:13.486201 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:13.486344 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:13.486519 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:13.486659 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:13.487404 55086 executor.go:111] Tasks: 136 done / 144 total; 2 can run W0518 19:58:13.487553 55086 api.go:53] PageSize not implemented I0518 19:58:13.487585 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:13.487818 55086 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0518 19:58:13.488000 55086 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0518 19:58:13.490153 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0518 19:58:13.490196 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:13.490222 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0518 19:58:13.490251 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:13.490271 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0518 19:58:13.490291 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0518 19:58:13.490313 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:13.490337 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0518 19:58:13.490360 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0518 19:58:13.490385 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0518 19:58:13.490408 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0518 19:58:13.490435 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:58:13.490456 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:58:13.490477 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:13.490500 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0518 19:58:13.490521 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0518 19:58:13.490545 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0518 19:58:13.490568 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:13.490591 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:13.490614 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:13.490636 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0518 19:58:13.490657 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:13.490681 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:13.490702 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:13.490725 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0518 19:58:13.490748 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0518 19:58:13.490771 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:58:13.490792 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0518 19:58:13.490812 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:13.490837 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:13.490860 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:58:13.490883 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0518 19:58:13.491885 55086 delete_cluster.go:128] Looking for cloud resources to delete W0518 19:58:13.491936 55086 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0518 19:58:13.491951 55086 keypairs.go:95] DescribeKeyPairs: { } I0518 19:58:13.491978 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.492018 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0518 19:58:13.492064 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.492104 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.492134 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.492169 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.492200 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.492233 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0518 19:58:13.492278 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.492320 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:13.492341 55086 natgateway.go:117] DescribeNatGateways: { } I0518 19:58:13.492366 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0518 19:58:13.492391 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W0518 19:58:13.492426 55086 api.go:53] PageSize not implemented I0518 19:58:13.492438 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0518 19:58:13.492465 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:13.492481 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:13.492491 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0518 19:58:13.492515 55086 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0518 19:58:13.492530 55086 targetgroups.go:35] PageSize not implemented I0518 19:58:13.492541 55086 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" ] } I0518 19:58:13.492581 55086 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0518 19:58:13.492612 55086 iamrole.go:89] ListRoles: { } I0518 19:58:13.492642 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:13.492661 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:13.492691 55086 internetgateways.go:101] DescribeInternetGateways: { } I0518 19:58:13.492723 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:13.492758 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3","rtb-1","rtb-2"] } I0518 19:58:13.492786 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0518 19:58:13.492806 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0518 19:58:13.493205 55086 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } load-balancer:api-privatekopeio-example-tl2bv8 ok I0518 19:58:13.493234 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0518 19:58:13.493265 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0518 19:58:13.493297 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok I0518 19:58:13.493290 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I0518 19:58:13.493301 55086 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } autoscaling-config:lt-2 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok I0518 19:58:13.493360 55086 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok I0518 19:58:13.493365 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:13.493397 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } autoscaling-group:bastion.privatekopeio.example.com ok I0518 19:58:13.493446 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0518 19:58:13.493497 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } autoscaling-group:nodes.privatekopeio.example.com ok I0518 19:58:13.493517 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } iam-instance-profile:masters.privatekopeio.example.com ok iam-instance-profile:nodes.privatekopeio.example.com ok I0518 19:58:13.493372 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.privatekopeio.example.com. ok I0518 19:58:13.493413 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0518 19:58:13.493569 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:13.493598 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0518 19:58:13.493659 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0518 19:58:13.493730 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:13.493831 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W0518 19:58:13.494019 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:13.494059 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I0518 19:58:13.494169 55086 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0518 19:58:13.494262 55086 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0518 19:58:13.494310 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W0518 19:58:13.494507 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:13.494523 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0518 19:58:13.494547 55086 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-3 ok I0518 19:58:13.494656 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I0518 19:58:13.494695 55086 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I0518 19:58:13.494731 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0518 19:58:13.494726 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0518 19:58:13.494771 55086 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I0518 19:58:13.494794 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } I0518 19:58:13.494804 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } subnet:subnet-4 ok I0518 19:58:13.494858 55086 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0518 19:58:13.494860 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:13.494871 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0518 19:58:13.494936 55086 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I0518 19:58:13.494900 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0518 19:58:13.494978 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I0518 19:58:13.495024 55086 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0518 19:58:13.495052 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } W0518 19:58:13.495004 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:13.495097 55086 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I0518 19:58:13.495125 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0518 19:58:13.495167 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0518 19:58:13.495209 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0518 19:58:13.495299 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0518 19:58:13.495343 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0518 19:58:13.495374 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0518 19:58:13.495423 55086 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0518 19:58:13.495474 55086 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (2.82s) === RUN TestLifecycleIPv6 I0518 19:58:13.495781 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:58:13.495878 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:58:13.495917 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:58:13.495945 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:58:13.495972 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:58:13.496004 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:58:13.496032 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:58:13.496052 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:58:13.496077 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:58:13.496096 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I0518 19:58:13.513968 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:58:13.516383 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:13.516441 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:14.821154 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:14.998256 55086 iamrole.go:89] ListRoles: { } I0518 19:58:15.000361 55086 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0518 19:58:15.000643 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.000740 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0518 19:58:15.000833 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] } I0518 19:58:15.000918 55086 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }] } I0518 19:58:15.001108 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0518 19:58:15.001133 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:15.001193 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] } I0518 19:58:15.001479 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:15.001694 55086 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0518 19:58:15.001882 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.002019 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.002205 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:15.002349 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:15.002403 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:15.002407 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:15.002551 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:15.002601 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.002771 55086 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }] } I0518 19:58:15.002855 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0518 19:58:15.002898 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0518 19:58:15.002931 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:58:15.002971 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:15.003439 55086 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0518 19:58:15.003597 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:15.003639 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0518 19:58:15.003704 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0518 19:58:15.003746 55086 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0518 19:58:15.003713 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.003760 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0518 19:58:15.003814 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0518 19:58:15.003822 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.003894 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0518 19:58:15.003876 55086 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0518 19:58:15.003986 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0518 19:58:15.003994 55086 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0518 19:58:15.003991 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:15.004028 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0518 19:58:15.004186 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0518 19:58:15.004255 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.004387 55086 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.004443 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:15.004473 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.004531 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0518 19:58:15.004610 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0518 19:58:15.004654 55086 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0518 19:58:15.004745 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0518 19:58:15.004944 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] }] } I0518 19:58:15.005010 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0518 19:58:15.005077 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0518 19:58:15.005042 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0518 19:58:15.004866 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0518 19:58:15.005193 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0518 19:58:15.005254 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0518 19:58:15.005342 55086 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0518 19:58:15.005383 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0518 19:58:15.005426 55086 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0518 19:58:15.005483 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0518 19:58:15.005574 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:15.005617 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:15.005644 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0518 19:58:15.005694 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:15.005720 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:15.005756 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0518 19:58:15.005847 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:15.005985 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:15.006049 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:15.006120 55086 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" } ] } I0518 19:58:15.006241 55086 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0518 19:58:15.006402 55086 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0518 19:58:15.006523 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:15.006592 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:15.006621 55086 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.006683 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:15.006822 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.006999 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0518 19:58:15.007105 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:15.007147 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:15.007171 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" }] }] } I0518 19:58:15.007288 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.007434 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0518 19:58:15.007504 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.007621 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0518 19:58:15.007703 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:15.007752 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0518 19:58:15.007846 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:15.007918 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.008020 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-1" } I0518 19:58:15.008054 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:15.008094 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.008158 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] }] } I0518 19:58:15.008226 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0518 19:58:15.008226 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.008279 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0518 19:58:15.008322 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.008389 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.008456 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0518 19:58:15.008467 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.008566 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:15.008624 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:15.008697 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-3" } I0518 19:58:15.008687 55086 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }] }] } I0518 19:58:15.008730 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:15.008778 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0518 19:58:15.008821 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0518 19:58:15.008876 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.008983 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0518 19:58:15.009078 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0518 19:58:15.009113 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.009203 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I0518 19:58:15.009316 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0518 19:58:15.009352 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:15.009396 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0518 19:58:15.009434 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0518 19:58:15.009457 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.009551 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.009638 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0518 19:58:15.009716 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0518 19:58:15.009812 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" }] }] } I0518 19:58:15.009896 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.009977 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0518 19:58:15.010019 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0518 19:58:15.010048 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0518 19:58:15.010072 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.010160 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0518 19:58:15.010188 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0518 19:58:15.010237 55086 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0518 19:58:15.010293 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:15.010367 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:15.010451 55086 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:15.010445 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:15.010511 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:15.010518 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:15.010555 55086 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.010586 55086 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-4"] }] } I0518 19:58:15.010584 55086 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-1" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I0518 19:58:15.010655 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:15.010679 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0518 19:58:15.010670 55086 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-4", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0518 19:58:15.010709 55086 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I0518 19:58:15.010739 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0518 19:58:15.010777 55086 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0518 19:58:15.010787 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0518 19:58:15.010836 55086 api.go:53] PageSize not implemented I0518 19:58:15.010923 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0518 19:58:15.010978 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I0518 19:58:15.011098 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0518 19:58:15.011129 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0518 19:58:15.011174 55086 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I0518 19:58:15.011241 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0518 19:58:15.011268 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0518 19:58:15.011316 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:15.011450 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I0518 19:58:15.011493 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-6" } I0518 19:58:15.011549 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:15.011734 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0518 19:58:15.011782 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I0518 19:58:15.011835 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:15.011902 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:15.011946 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:15.011977 55086 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0518 19:58:15.012018 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0518 19:58:15.012041 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0518 19:58:15.012084 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I0518 19:58:15.012119 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-5" } I0518 19:58:15.012211 55086 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0518 19:58:15.012308 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:15.012353 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:15.012325 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:15.012314 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:15.012378 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0518 19:58:15.012461 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-1" } I0518 19:58:15.012515 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:15.012540 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:15.012570 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:15.012450 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:15.012580 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0518 19:58:15.012608 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:15.012605 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-3" } I0518 19:58:15.012690 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:15.012707 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:15.012784 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-3" } I0518 19:58:15.012812 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:15.012877 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-1" } I0518 19:58:15.015614 55086 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0518 19:58:15.015738 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:15.015857 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:15.015954 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:15.016071 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:15.016549 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:58:15.016866 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:58:15.017175 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0518 19:58:15.017233 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:15.017274 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:15.017342 55086 dns.go:235] Pre-creating DNS records I0518 19:58:15.017373 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:15.024285 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0518 19:58:15.028102 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:15.028189 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:16.315265 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:16.487666 55086 iamrole.go:89] ListRoles: { } I0518 19:58:16.489247 55086 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0518 19:58:16.489598 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.489776 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.489905 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.490017 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.490104 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:16.490132 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:16.490227 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:16.490249 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:16.490677 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:16.492211 55086 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0518 19:58:16.492353 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0518 19:58:16.492421 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0518 19:58:16.492355 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0518 19:58:16.492446 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0518 19:58:16.492492 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0518 19:58:16.492518 55086 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0518 19:58:16.492489 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.492578 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.492785 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.492998 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0518 19:58:16.493233 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:16.493352 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:16.493506 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:16.493583 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:16.493713 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.493912 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.494120 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0518 19:58:16.494403 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:16.494989 55086 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0518 19:58:16.495113 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:16.495262 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:16.495367 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.495502 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0518 19:58:16.495538 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:16.495645 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:16.495709 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0518 19:58:16.495742 55086 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0518 19:58:16.495774 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0518 19:58:16.495881 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] }] } I0518 19:58:16.496010 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:16.496122 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.496234 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0518 19:58:16.496266 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.496364 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:16.496418 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:16.496487 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.496583 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:16.496612 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:16.496663 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0518 19:58:16.496694 55086 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0518 19:58:16.496719 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0518 19:58:16.496757 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.496891 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0518 19:58:16.497016 55086 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0518 19:58:16.497100 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:16.497188 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:16.497253 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:16.497316 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:16.497335 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0518 19:58:16.497378 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0518 19:58:16.497313 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:16.497426 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0518 19:58:16.497465 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0518 19:58:16.497514 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } W0518 19:58:16.497600 55086 api.go:53] PageSize not implemented I0518 19:58:16.497463 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0518 19:58:16.497728 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:16.497821 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:16.497890 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0518 19:58:16.497946 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:16.498022 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:16.498090 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:16.498190 55086 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0518 19:58:16.498254 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:16.498303 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:16.498279 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:16.498342 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:16.498402 55086 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0518 19:58:16.498323 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0518 19:58:16.498436 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:16.498369 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:16.498517 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0518 19:58:16.498548 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0518 19:58:16.498473 55086 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0518 19:58:16.498577 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0518 19:58:16.498583 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:16.498662 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0518 19:58:16.498915 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:16.498985 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0518 19:58:16.499119 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:16.499147 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0518 19:58:16.504085 55086 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0518 19:58:16.504235 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:16.504430 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:16.504546 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:16.504716 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:16.505161 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:58:16.505454 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:58:16.505670 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0518 19:58:16.508996 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0518 19:58:16.509063 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:16.509114 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0518 19:58:16.509152 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I0518 19:58:16.509189 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0518 19:58:16.509225 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:16.509259 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0518 19:58:16.509292 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0518 19:58:16.509323 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0518 19:58:16.509365 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:16.509408 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0518 19:58:16.509444 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0518 19:58:16.509482 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0518 19:58:16.509524 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0518 19:58:16.509560 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0518 19:58:16.509596 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:58:16.509628 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:58:16.509670 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:16.509705 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0518 19:58:16.509736 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0518 19:58:16.509771 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0518 19:58:16.509806 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:16.509840 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:16.509876 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:16.509912 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:16.509956 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:16.509987 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:16.510023 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0518 19:58:16.510067 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0518 19:58:16.510108 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0518 19:58:16.510145 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0518 19:58:16.510181 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:58:16.510213 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0518 19:58:16.510250 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:16.510286 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:16.510332 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:58:16.510378 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0518 19:58:16.512484 55086 delete_cluster.go:128] Looking for cloud resources to delete W0518 19:58:16.512556 55086 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0518 19:58:16.512578 55086 keypairs.go:95] DescribeKeyPairs: { } I0518 19:58:16.512618 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.512681 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0518 19:58:16.512747 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.512809 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.512862 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.512914 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.512973 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.513023 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0518 19:58:16.513092 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.513181 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:16.513222 55086 natgateway.go:117] DescribeNatGateways: { } I0518 19:58:16.513277 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0518 19:58:16.513318 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W0518 19:58:16.513383 55086 api.go:53] PageSize not implemented I0518 19:58:16.513409 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:16.513436 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:16.513451 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0518 19:58:16.513494 55086 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0518 19:58:16.513522 55086 targetgroups.go:35] PageSize not implemented I0518 19:58:16.513540 55086 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0518 19:58:16.513598 55086 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0518 19:58:16.513641 55086 iamrole.go:89] ListRoles: { } I0518 19:58:16.513697 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:16.513727 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:16.513769 55086 internetgateways.go:101] DescribeInternetGateways: { } I0518 19:58:16.513817 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:16.513877 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2","rtb-3"] } I0518 19:58:16.513924 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0518 19:58:16.513968 55086 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0518 19:58:16.514008 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0518 19:58:16.514039 55086 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } autoscaling-config:lt-1 ok I0518 19:58:16.514762 55086 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I0518 19:58:16.514799 55086 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0518 19:58:16.514831 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I0518 19:58:16.514864 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } I0518 19:58:16.514842 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } volume:vol-2 ok autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok I0518 19:58:16.514931 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } autoscaling-group:nodes.minimal-ipv6.example.com ok iam-instance-profile:masters.minimal-ipv6.example.com ok I0518 19:58:16.514901 55086 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I0518 19:58:16.514895 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } I0518 19:58:16.514983 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } subnet:subnet-4 ok I0518 19:58:16.515027 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } iam-instance-profile:nodes.minimal-ipv6.example.com ok volume:vol-1 ok I0518 19:58:16.515040 55086 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I0518 19:58:16.515121 55086 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } I0518 19:58:16.514915 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } keypair:key-1 ok route53-record:Z1AFAKE1ZON3YO/AAAA/kops-controller.internal.minimal-ipv6.example.com. ok I0518 19:58:16.515182 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:16.515242 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0518 19:58:16.515533 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:16.515560 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0518 19:58:16.515597 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:16.515660 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0518 19:58:16.515805 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:16.515827 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0518 19:58:16.515876 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:16.515927 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0518 19:58:16.515966 55086 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0518 19:58:16.516034 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0518 19:58:16.516093 55086 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0518 19:58:16.516189 55086 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0518 19:58:16.516234 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok I0518 19:58:16.516356 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I0518 19:58:16.516408 55086 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0518 19:58:16.516382 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0518 19:58:16.516426 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0518 19:58:16.516490 55086 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I0518 19:58:16.516473 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0518 19:58:16.516538 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I0518 19:58:16.516587 55086 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0518 19:58:16.516567 55086 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0518 19:58:16.516604 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0518 19:58:16.516634 55086 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I0518 19:58:16.516631 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0518 19:58:16.516690 55086 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I0518 19:58:16.516749 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I0518 19:58:16.516847 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0518 19:58:16.516909 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0518 19:58:16.516981 55086 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0518 19:58:16.517062 55086 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (3.02s) === RUN TestLifecycleSharedVPC I0518 19:58:16.517548 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:58:16.517716 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:58:16.517758 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:58:16.517808 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:58:16.517846 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:58:16.517905 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:58:16.517960 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:58:16.517988 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:58:16.518022 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:58:16.518049 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I0518 19:58:16.540736 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:16.543354 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:16.543421 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:17.866476 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:18.034539 55086 iamrole.go:89] ListRoles: { } I0518 19:58:18.035482 55086 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0518 19:58:18.038440 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:18.038531 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:18.038526 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0518 19:58:18.038740 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0518 19:58:18.038726 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:18.038923 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:18.039179 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:18.039559 55086 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0518 19:58:18.040380 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:58:18.040492 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0518 19:58:18.040537 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0518 19:58:18.040610 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I0518 19:58:18.040684 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0518 19:58:18.041025 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:18.042123 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:18.042320 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:18.043814 55086 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0518 19:58:18.044070 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0518 19:58:18.044231 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0518 19:58:18.044362 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0518 19:58:18.044333 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0518 19:58:18.044494 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:18.044554 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:18.044599 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0518 19:58:18.044757 55086 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0518 19:58:18.044788 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0518 19:58:18.044876 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:18.044928 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:18.044940 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0518 19:58:18.044968 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:58:18.045054 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0518 19:58:18.045090 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:18.045281 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:18.045410 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0518 19:58:18.045290 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], VpcId: "vpc-12345678" } I0518 19:58:18.045528 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:18.045530 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0518 19:58:18.045590 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:18.045645 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:18.045692 55086 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] } I0518 19:58:18.046123 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0518 19:58:18.050271 55086 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0518 19:58:18.050434 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:18.050612 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0518 19:58:18.050675 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0518 19:58:18.050857 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" }] }] } I0518 19:58:18.050994 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0518 19:58:18.051174 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0518 19:58:18.051324 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0518 19:58:18.051447 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0518 19:58:18.051581 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0518 19:58:18.051669 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0518 19:58:18.051759 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:18.051829 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:18.052026 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" }] }] } I0518 19:58:18.052243 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0518 19:58:18.052491 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0518 19:58:18.052653 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:18.052724 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:18.052800 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" }] }] } I0518 19:58:18.052940 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:18.053045 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0518 19:58:18.053226 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0518 19:58:18.053375 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0518 19:58:18.053423 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0518 19:58:18.053464 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0518 19:58:18.053518 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:18.054021 55086 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0518 19:58:18.054264 55086 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0518 19:58:18.054532 55086 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0518 19:58:18.054577 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:18.054615 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:18.054681 55086 dns.go:235] Pre-creating DNS records I0518 19:58:18.054713 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:18.060468 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:18.063668 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:18.063752 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:19.377026 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:19.537306 55086 iamrole.go:89] ListRoles: { } I0518 19:58:19.538715 55086 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0518 19:58:19.538944 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:58:19.539032 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0518 19:58:19.539052 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0518 19:58:19.539148 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:19.539285 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:19.540046 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:19.540704 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:19.541826 55086 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0518 19:58:19.542015 55086 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0518 19:58:19.541950 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0518 19:58:19.542121 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0518 19:58:19.542139 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:19.542189 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0518 19:58:19.542360 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:19.542422 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:58:19.542541 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:19.542682 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] }] } I0518 19:58:19.542819 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:19.545439 55086 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0518 19:58:19.545533 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:19.545638 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:19.545768 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:19.545887 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:19.546035 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:19.546307 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:19.546502 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:19.547292 55086 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0518 19:58:19.547519 55086 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0518 19:58:19.547806 55086 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0518 19:58:19.550354 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0518 19:58:19.550422 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0518 19:58:19.550459 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:19.550491 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0518 19:58:19.550523 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0518 19:58:19.550558 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0518 19:58:19.550594 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0518 19:58:19.550630 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0518 19:58:19.550668 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:58:19.550700 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:58:19.550729 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:19.550762 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0518 19:58:19.550789 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:19.550820 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:19.550850 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:19.550883 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:19.550912 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:58:19.550939 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0518 19:58:19.550968 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:19.551000 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:19.551091 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0518 19:58:19.552389 55086 delete_cluster.go:128] Looking for cloud resources to delete W0518 19:58:19.552454 55086 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0518 19:58:19.552476 55086 keypairs.go:95] DescribeKeyPairs: { } I0518 19:58:19.552520 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:19.552568 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0518 19:58:19.552621 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:19.552677 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:19.552720 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:19.552761 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:19.552803 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:19.552840 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0518 19:58:19.552885 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:19.552934 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0518 19:58:19.552967 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W0518 19:58:19.553016 55086 api.go:53] PageSize not implemented I0518 19:58:19.553039 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:19.553065 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:19.553085 55086 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0518 19:58:19.553110 55086 targetgroups.go:35] PageSize not implemented I0518 19:58:19.553130 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0518 19:58:19.553178 55086 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0518 19:58:19.553213 55086 iamrole.go:89] ListRoles: { } I0518 19:58:19.553255 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:19.553283 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:19.553326 55086 internetgateways.go:101] DescribeInternetGateways: { } I0518 19:58:19.553364 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:19.553396 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-config:lt-1 ok I0518 19:58:19.553790 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.sharedvpc.example.com ok I0518 19:58:19.553868 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0518 19:58:19.553851 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } I0518 19:58:19.553960 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } W0518 19:58:19.553978 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-instance-profile:masters.sharedvpc.example.com ok autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I0518 19:58:19.553997 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0518 19:58:19.554002 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0518 19:58:19.554047 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok I0518 19:58:19.554044 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0518 19:58:19.553808 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-config:lt-2 ok route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.sharedvpc.example.com. ok I0518 19:58:19.554119 55086 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0518 19:58:19.554180 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:19.554228 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0518 19:58:19.554431 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:19.554462 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0518 19:58:19.554507 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0518 19:58:19.554596 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0518 19:58:19.554664 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I0518 19:58:19.554716 55086 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I0518 19:58:19.554732 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0518 19:58:19.554764 55086 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I0518 19:58:19.554820 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I0518 19:58:19.554898 55086 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0518 19:58:19.554924 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0518 19:58:19.554975 55086 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I0518 19:58:19.555069 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (3.04s) === RUN TestLifecycleComplex I0518 19:58:19.555612 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:58:19.555767 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:58:19.555818 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:58:19.555888 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:58:19.555955 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:58:19.556036 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:58:19.556091 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:58:19.556145 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:58:19.556214 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:58:19.556263 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I0518 19:58:19.591324 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:58:19.595338 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:19.595435 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:20.901541 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:21.080540 55086 iamrole.go:89] ListRoles: { } I0518 19:58:21.081921 55086 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0518 19:58:21.082197 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0518 19:58:21.082247 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0518 19:58:21.082341 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" } ] } W0518 19:58:21.082307 55086 api.go:53] PageSize not implemented I0518 19:58:21.082261 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:21.082362 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:21.082550 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:21.082677 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:21.082719 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:21.082832 55086 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" } ] }] } I0518 19:58:21.084300 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:21.084399 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0518 19:58:21.084536 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:21.084564 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0518 19:58:21.084730 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] } I0518 19:58:21.085033 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0518 19:58:21.085217 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0518 19:58:21.085045 55086 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0518 19:58:21.085456 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0518 19:58:21.085499 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0518 19:58:21.085539 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:58:21.085605 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:21.085845 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:21.086097 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:21.086218 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:21.089491 55086 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0518 19:58:21.089706 55086 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0518 19:58:21.089641 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:21.089742 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0518 19:58:21.089840 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0518 19:58:21.089794 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0518 19:58:21.089905 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:21.089931 55086 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0518 19:58:21.089971 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0518 19:58:21.090058 55086 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0518 19:58:21.090042 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0518 19:58:21.090060 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0518 19:58:21.090131 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0518 19:58:21.090278 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:21.090331 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0518 19:58:21.090378 55086 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0518 19:58:21.090464 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:21.090575 55086 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0518 19:58:21.090625 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0518 19:58:21.090662 55086 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0518 19:58:21.090739 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:21.090923 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:21.090942 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0518 19:58:21.091107 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:21.091163 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:21.091211 55086 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0518 19:58:21.091322 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:21.091370 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0518 19:58:21.091568 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0518 19:58:21.091822 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:21.091958 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0518 19:58:21.092074 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }], VpcId: "vpc-1" } I0518 19:58:21.092102 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:21.092333 55086 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I0518 19:58:21.092144 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0518 19:58:21.092414 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:21.092347 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0518 19:58:21.092508 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0518 19:58:21.092639 55086 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0518 19:58:21.092678 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:21.092758 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0518 19:58:21.092848 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0518 19:58:21.092946 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0518 19:58:21.092994 55086 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" } ] } I0518 19:58:21.093107 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:21.093206 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:21.093276 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:21.093350 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:21.093395 55086 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I0518 19:58:21.093441 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:21.093493 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:21.093549 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:21.093624 55086 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0518 19:58:21.093722 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:21.093812 55086 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0518 19:58:21.093940 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:21.094039 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:21.094186 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:21.094310 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:21.094175 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0518 19:58:21.094517 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0518 19:58:21.094590 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:21.094633 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:21.094787 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-1", TransitGatewayId: "tgw-0123456" } I0518 19:58:21.094936 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I0518 19:58:21.095124 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0518 19:58:21.095240 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0518 19:58:21.095402 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0518 19:58:21.095591 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:21.095673 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0518 19:58:21.095891 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-1", TransitGatewayId: "tgw-123456" } I0518 19:58:21.095997 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0518 19:58:21.096178 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0518 19:58:21.096285 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0518 19:58:21.096385 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I0518 19:58:21.096506 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:21.096620 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0518 19:58:21.096707 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0518 19:58:21.096764 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0518 19:58:21.096922 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0518 19:58:21.097078 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" } ] }] } I0518 19:58:21.097234 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0518 19:58:21.097332 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I0518 19:58:21.097467 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0518 19:58:21.097645 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0518 19:58:21.097755 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0518 19:58:21.097940 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" } ] }] } I0518 19:58:21.098120 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I0518 19:58:21.098243 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0518 19:58:21.098411 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0518 19:58:21.098587 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I0518 19:58:21.098713 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" } ] }] } I0518 19:58:21.098887 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" } ] }] } I0518 19:58:21.099068 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0518 19:58:21.099245 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0518 19:58:21.099316 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0518 19:58:21.099439 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0518 19:58:21.099614 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0518 19:58:21.099686 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0518 19:58:21.099862 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0518 19:58:21.099954 55086 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0518 19:58:21.100052 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:21.100070 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:21.100170 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:21.100267 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0518 19:58:21.100335 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0518 19:58:21.100336 55086 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-1" }], Tags: [ { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], Type: "network" } I0518 19:58:21.100489 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:21.100548 55086 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0518 19:58:21.100633 55086 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0518 19:58:21.100708 55086 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0518 19:58:21.100779 55086 api.go:53] PageSize not implemented I0518 19:58:21.100842 55086 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0518 19:58:21.100895 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:21.100979 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:21.100956 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:21.101035 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:21.101158 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:21.101238 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:21.101296 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:21.101311 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:21.101299 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:21.101481 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:21.104863 55086 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0518 19:58:21.105080 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:21.105215 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:21.105317 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:21.105444 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:21.106008 55086 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0518 19:58:21.106316 55086 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0518 19:58:21.106591 55086 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0518 19:58:21.106646 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:21.106684 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:21.106749 55086 dns.go:235] Pre-creating DNS records I0518 19:58:21.106774 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:21.114980 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:58:21.119196 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:21.119292 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:22.398555 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:22.592189 55086 iamrole.go:89] ListRoles: { } I0518 19:58:22.594335 55086 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0518 19:58:22.594656 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0518 19:58:22.594881 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0518 19:58:22.594841 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:22.595087 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0518 19:58:22.595224 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0518 19:58:22.595490 55086 api.go:53] PageSize not implemented I0518 19:58:22.596124 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:22.596237 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:22.596264 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:22.596311 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:22.596813 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:22.597043 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0518 19:58:22.597627 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0518 19:58:22.598862 55086 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0518 19:58:22.599049 55086 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0518 19:58:22.599014 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0518 19:58:22.599127 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:22.599008 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:22.599207 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0518 19:58:22.599195 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0518 19:58:22.599265 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:22.599443 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:22.599402 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0518 19:58:22.599509 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:22.599582 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0518 19:58:22.599495 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:22.599689 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:22.599784 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0518 19:58:22.599943 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:22.600012 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:22.600096 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0518 19:58:22.600241 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:22.600305 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0518 19:58:22.600536 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:22.600587 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:22.600697 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:22.600806 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:22.600905 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:22.601126 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:22.601271 55086 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0518 19:58:22.601508 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:22.601657 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:22.602081 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:22.602281 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:22.602375 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:22.602484 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:22.602759 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] }] } I0518 19:58:22.602922 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:22.603126 55086 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0518 19:58:22.603226 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:22.603304 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:22.603323 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:22.603298 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:22.603370 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:22.603412 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:22.603454 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:22.603491 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:22.603525 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0518 19:58:22.603617 55086 api.go:53] PageSize not implemented I0518 19:58:22.603665 55086 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0518 19:58:22.603731 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:22.603775 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:22.603744 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:22.603817 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:22.603848 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:22.603857 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:22.603965 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:22.603949 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:22.604031 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:22.604060 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:22.604206 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:22.604263 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:22.604445 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:22.604476 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:22.609700 55086 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0518 19:58:22.609815 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:22.609970 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:22.610059 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:22.610219 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:22.610733 55086 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0518 19:58:22.612445 55086 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0518 19:58:22.612857 55086 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I0518 19:58:22.621767 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:22.625280 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:22.638568 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:58:22.642608 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:22.642699 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:23.922752 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:24.122147 55086 iamrole.go:89] ListRoles: { } I0518 19:58:24.124327 55086 executor.go:111] Tasks: 0 done / 135 total; 51 can run W0518 19:58:24.124693 55086 api.go:53] PageSize not implemented I0518 19:58:24.124627 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:24.124901 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:24.124968 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:24.125052 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:24.125100 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:24.125228 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:24.125320 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0518 19:58:24.125402 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0518 19:58:24.125455 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0518 19:58:24.125549 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:24.125680 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0518 19:58:24.125863 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0518 19:58:24.127080 55086 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0518 19:58:24.127166 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0518 19:58:24.127286 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0518 19:58:24.127330 55086 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0518 19:58:24.127315 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:24.127419 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0518 19:58:24.127415 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:24.127507 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:24.127561 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0518 19:58:24.127576 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:24.127621 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0518 19:58:24.127633 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:24.127664 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:24.127731 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0518 19:58:24.127750 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:24.127858 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:24.127924 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:24.127980 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:24.128101 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:24.128165 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0518 19:58:24.128302 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:24.128367 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0518 19:58:24.128534 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:24.128586 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:24.128718 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:24.128797 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:24.128887 55086 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0518 19:58:24.129060 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:24.129122 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:24.129187 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:24.129508 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:24.129995 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:24.130169 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:24.130270 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:24.130346 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:24.130593 55086 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0518 19:58:24.130733 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:24.130747 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:24.130888 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:24.130902 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:24.130931 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:24.130965 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:24.130989 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:24.131036 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:24.131082 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:24.131210 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I0518 19:58:24.131235 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:24.131255 55086 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I0518 19:58:24.131275 55086 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I0518 19:58:24.131295 55086 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0518 19:58:24.131354 55086 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0518 19:58:24.131397 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:24.131418 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W0518 19:58:24.131444 55086 api.go:53] PageSize not implemented I0518 19:58:24.131472 55086 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0518 19:58:24.131520 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:24.131549 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:24.131534 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0518 19:58:24.131552 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:24.131624 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0518 19:58:24.131572 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:24.131679 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:24.131776 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:24.131850 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:24.132037 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:24.132106 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:24.132144 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:24.132283 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:24.132343 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:24.137817 55086 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0518 19:58:24.137968 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:24.138151 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:24.138306 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:24.138505 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:24.139066 55086 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0518 19:58:24.139370 55086 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0518 19:58:24.139620 55086 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0518 19:58:24.139660 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:24.139685 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:24.139728 55086 dns.go:235] Pre-creating DNS records I0518 19:58:24.147944 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:58:24.150324 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:24.150383 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:25.451117 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:25.627294 55086 iamrole.go:89] ListRoles: { } I0518 19:58:25.629433 55086 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0518 19:58:25.629895 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:25.630097 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0518 19:58:25.630419 55086 api.go:53] PageSize not implemented I0518 19:58:25.630630 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0518 19:58:25.630865 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0518 19:58:25.630937 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0518 19:58:25.631017 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:25.630998 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0518 19:58:25.631119 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:25.631141 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:25.631177 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:25.631202 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0518 19:58:25.631270 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:25.632678 55086 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0518 19:58:25.632928 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:25.633014 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0518 19:58:25.633101 55086 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0518 19:58:25.633148 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:25.633181 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0518 19:58:25.633222 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0518 19:58:25.633159 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:25.633346 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0518 19:58:25.633466 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:25.633514 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0518 19:58:25.633404 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:25.633661 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:25.633782 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:25.633975 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:25.634050 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0518 19:58:25.634266 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:25.634355 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:25.634497 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:25.634576 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:25.634683 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:25.634758 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0518 19:58:25.634870 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0518 19:58:25.634982 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:25.635216 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:25.635337 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:25.635462 55086 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0518 19:58:25.635757 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] }] } I0518 19:58:25.635955 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:25.636058 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:25.636308 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:25.636400 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:25.636653 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:25.636857 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:25.637031 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:25.637142 55086 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0518 19:58:25.637222 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0518 19:58:25.637229 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0518 19:58:25.637285 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:25.637369 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:25.637419 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:25.637457 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:25.637496 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:25.637530 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:25.637562 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0518 19:58:25.637654 55086 api.go:53] PageSize not implemented I0518 19:58:25.637737 55086 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0518 19:58:25.637796 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:25.637849 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:25.637861 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:25.637912 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:25.637868 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:25.637927 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:25.638002 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:25.638028 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:25.638057 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:25.638210 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:25.638282 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:25.638314 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:25.638417 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:25.638468 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:25.644398 55086 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0518 19:58:25.644548 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:25.644726 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:25.644921 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:25.645108 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:25.645722 55086 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0518 19:58:25.646051 55086 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0518 19:58:25.646361 55086 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I0518 19:58:25.649776 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:25.653334 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:25.665601 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:58:25.669672 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:25.669762 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:26.958123 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:27.110864 55086 iamrole.go:89] ListRoles: { } I0518 19:58:27.113085 55086 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0518 19:58:27.113869 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:27.114105 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:27.114166 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:27.114255 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0518 19:58:27.114487 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:27.114545 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:27.114715 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0518 19:58:27.114897 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:27.115066 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0518 19:58:27.115135 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } W0518 19:58:27.115423 55086 api.go:53] PageSize not implemented I0518 19:58:27.115594 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0518 19:58:27.115809 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:27.116053 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:27.117862 55086 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0518 19:58:27.117965 55086 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0518 19:58:27.118006 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0518 19:58:27.118068 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0518 19:58:27.118157 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:27.118007 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:27.118199 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0518 19:58:27.118268 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0518 19:58:27.118297 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:27.118330 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:27.118362 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0518 19:58:27.118383 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:27.118594 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:27.118701 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0518 19:58:27.118867 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:27.118912 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:27.119063 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:27.119157 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:27.119249 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0518 19:58:27.119426 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:27.119485 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:27.119615 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:27.119704 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0518 19:58:27.119876 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:27.119926 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:27.120114 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:27.120197 55086 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0518 19:58:27.120392 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:27.120497 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:27.120700 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:27.120749 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:27.120953 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:27.121239 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:27.121464 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:27.121899 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:27.122027 55086 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0518 19:58:27.122113 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:27.122179 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:27.122147 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:27.122200 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:27.122292 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:27.122339 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:27.122380 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:27.122414 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:27.122453 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0518 19:58:27.122550 55086 api.go:53] PageSize not implemented I0518 19:58:27.122604 55086 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0518 19:58:27.122663 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:27.122745 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:27.122736 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:27.122819 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:27.122785 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:27.122854 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:27.122890 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:27.122886 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:27.122973 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:27.123003 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:27.123188 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:27.123252 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:27.123418 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:27.123462 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:27.128631 55086 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0518 19:58:27.128878 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:27.129060 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:27.129175 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:27.129339 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:27.130076 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:27.130142 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:27.130301 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:58:27.130530 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:58:27.130805 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0518 19:58:27.130859 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:27.130898 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:27.130967 55086 dns.go:235] Pre-creating DNS records I0518 19:58:27.138817 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:58:27.142995 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:27.143120 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:28.449751 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:28.586438 55086 iamrole.go:89] ListRoles: { } I0518 19:58:28.587680 55086 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0518 19:58:28.587875 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0518 19:58:28.588111 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:28.588199 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } W0518 19:58:28.588384 55086 api.go:53] PageSize not implemented I0518 19:58:28.588420 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:28.588593 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:28.588684 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:28.588718 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:28.588775 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:28.588816 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:28.588979 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0518 19:58:28.589140 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:28.589300 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0518 19:58:28.589907 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0518 19:58:28.591618 55086 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0518 19:58:28.591738 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0518 19:58:28.591899 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0518 19:58:28.591858 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0518 19:58:28.591951 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:28.592005 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0518 19:58:28.592025 55086 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0518 19:58:28.591960 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:28.592127 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:28.592232 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0518 19:58:28.592310 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:28.592236 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0518 19:58:28.592358 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0518 19:58:28.592455 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:28.592523 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:28.592617 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:28.592756 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I0518 19:58:28.592891 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:28.592985 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:28.593113 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:28.593154 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0518 19:58:28.593275 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:28.593348 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:28.593441 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0518 19:58:28.593554 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:28.593689 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:28.593803 55086 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0518 19:58:28.593925 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:28.594189 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:28.594410 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:28.594527 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:28.594856 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:28.594987 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:28.595073 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:28.595326 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:28.595584 55086 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0518 19:58:28.595675 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:28.595744 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:28.595723 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:28.595758 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:28.595835 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:28.595869 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:28.595900 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:28.595924 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:28.595948 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0518 19:58:28.596016 55086 api.go:53] PageSize not implemented I0518 19:58:28.596050 55086 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0518 19:58:28.596092 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0518 19:58:28.596109 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:28.596145 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:28.596163 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:28.596185 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0518 19:58:28.596125 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:28.596208 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:28.596301 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:28.596344 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:28.596360 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:28.596438 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:28.596474 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:28.596556 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:28.596595 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:28.601205 55086 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0518 19:58:28.601398 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:28.601554 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:28.601675 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:28.601857 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:28.602412 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:58:28.602643 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:58:28.602940 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I0518 19:58:28.607821 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:28.611252 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:28.611341 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:28.621021 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:58:28.625180 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:28.625271 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:28.625328 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:29.925861 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:30.105108 55086 iamrole.go:89] ListRoles: { } I0518 19:58:30.107141 55086 executor.go:111] Tasks: 0 done / 136 total; 52 can run W0518 19:58:30.107637 55086 api.go:53] PageSize not implemented I0518 19:58:30.107632 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:30.107742 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:30.107778 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0518 19:58:30.107928 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0518 19:58:30.108027 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0518 19:58:30.108105 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0518 19:58:30.108184 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:30.108306 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:30.108343 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:30.108384 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:30.108595 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:30.108668 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0518 19:58:30.108797 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:30.109762 55086 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0518 19:58:30.109871 55086 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0518 19:58:30.109999 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0518 19:58:30.109955 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:30.110033 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0518 19:58:30.110079 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:30.110125 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:30.110168 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0518 19:58:30.110191 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0518 19:58:30.110255 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0518 19:58:30.110334 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:30.110383 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0518 19:58:30.110392 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:30.110436 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0518 19:58:30.110614 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:30.110719 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:30.110868 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:30.111049 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:30.111117 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0518 19:58:30.111292 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:30.111347 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:30.111428 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:30.111542 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:30.111679 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0518 19:58:30.111852 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:30.111924 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:30.112136 55086 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0518 19:58:30.112292 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] }] } I0518 19:58:30.112406 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:30.112743 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:30.112872 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:30.113349 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:30.113428 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:30.113525 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:30.113703 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:30.113980 55086 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0518 19:58:30.114053 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:30.114108 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:30.114203 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:30.114238 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:30.114277 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:30.114358 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:30.114419 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:30.114442 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:30.114471 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0518 19:58:30.114565 55086 api.go:53] PageSize not implemented I0518 19:58:30.114634 55086 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0518 19:58:30.114730 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:30.114747 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:30.114823 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:30.114826 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:30.114861 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:30.114788 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:30.114847 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:30.114959 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:30.115022 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:30.115038 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:30.115136 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:30.115175 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:30.115240 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:30.115258 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:30.120037 55086 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0518 19:58:30.120189 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:30.120282 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:30.120346 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:30.120449 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:30.121708 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:58:30.122539 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:58:30.122977 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0518 19:58:30.123173 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:30.123302 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:30.123495 55086 dns.go:235] Pre-creating DNS records I0518 19:58:30.131197 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:58:30.135417 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:30.135542 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:30.135638 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:31.448046 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:31.636777 55086 iamrole.go:89] ListRoles: { } I0518 19:58:31.640453 55086 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0518 19:58:31.640827 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:31.641030 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0518 19:58:31.641141 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0518 19:58:31.641202 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:31.641416 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0518 19:58:31.641562 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:31.641597 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:31.641656 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:31.642235 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:31.642318 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0518 19:58:31.642797 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0518 19:58:31.642949 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0518 19:58:31.643178 55086 api.go:53] PageSize not implemented I0518 19:58:31.643360 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:31.645526 55086 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0518 19:58:31.645608 55086 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0518 19:58:31.645667 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:31.645714 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0518 19:58:31.645723 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0518 19:58:31.645761 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:31.645806 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:31.645845 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0518 19:58:31.645833 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0518 19:58:31.645922 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0518 19:58:31.645985 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:31.645951 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:31.646022 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0518 19:58:31.646080 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:31.646120 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:31.646176 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:31.646217 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:31.646271 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:31.646321 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:31.646370 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:31.646400 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:31.646493 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0518 19:58:31.646603 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:31.646651 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:31.646783 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0518 19:58:31.646931 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:31.647037 55086 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0518 19:58:31.647234 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:31.647329 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:31.647456 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:31.647933 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:31.648074 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:31.648168 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:31.648331 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:31.648521 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:31.648643 55086 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0518 19:58:31.648727 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0518 19:58:31.648725 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0518 19:58:31.648795 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:31.648851 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:31.648904 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:31.648941 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:31.648978 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:31.649011 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:31.649043 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0518 19:58:31.649135 55086 api.go:53] PageSize not implemented I0518 19:58:31.649192 55086 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0518 19:58:31.649242 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0518 19:58:31.649270 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0518 19:58:31.649292 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:31.649309 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:31.649330 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:31.649319 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:31.649377 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:31.649390 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:31.649405 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:31.649443 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:31.649475 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:31.649486 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:31.649553 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:31.649583 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:31.654912 55086 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0518 19:58:31.655015 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:31.655158 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:31.655380 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:31.655584 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:31.656173 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:58:31.656407 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:58:31.656595 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I0518 19:58:31.658339 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:31.660263 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:31.660316 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:31.660348 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:31.665824 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:58:31.668148 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:31.668198 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:31.668229 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:31.668254 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:32.961081 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:33.143001 55086 iamrole.go:89] ListRoles: { } I0518 19:58:33.144786 55086 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0518 19:58:33.144931 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0518 19:58:33.145142 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W0518 19:58:33.145229 55086 api.go:53] PageSize not implemented I0518 19:58:33.145206 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:33.146239 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:33.146627 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0518 19:58:33.147143 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:33.147336 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0518 19:58:33.148180 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0518 19:58:33.149315 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0518 19:58:33.149406 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:33.149803 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:33.149877 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:33.150505 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:33.151947 55086 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0518 19:58:33.152097 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0518 19:58:33.152110 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:33.152163 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:33.152191 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0518 19:58:33.152203 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:33.152263 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:33.152265 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0518 19:58:33.152348 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:33.152341 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:33.152377 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:33.152419 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0518 19:58:33.152415 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0518 19:58:33.152430 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0518 19:58:33.152503 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:33.152527 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:33.152596 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0518 19:58:33.152683 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I0518 19:58:33.152772 55086 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0518 19:58:33.152781 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:33.152829 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:33.152881 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:33.152919 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0518 19:58:33.153001 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:33.153047 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0518 19:58:33.153120 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:33.153171 55086 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0518 19:58:33.153301 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:33.153494 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:33.153589 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:33.153695 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:33.153789 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:33.153921 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:33.154333 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:33.154596 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:33.154789 55086 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0518 19:58:33.154869 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:33.154936 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:33.155043 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:33.155074 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:33.155136 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:33.155189 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:33.155242 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:33.155292 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:33.155335 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0518 19:58:33.155463 55086 api.go:53] PageSize not implemented I0518 19:58:33.155530 55086 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0518 19:58:33.155602 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:33.155656 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:33.155636 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:33.155701 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:33.155676 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:33.155733 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:33.155777 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:33.155800 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:33.155827 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:33.155959 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:33.156018 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:33.156127 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:33.156187 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:33.156212 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:33.161925 55086 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0518 19:58:33.162089 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:33.162276 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:33.162484 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:33.162659 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:33.163445 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:58:33.163762 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:58:33.163957 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0518 19:58:33.164011 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:33.164050 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:33.164118 55086 dns.go:235] Pre-creating DNS records I0518 19:58:33.172251 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0518 19:58:33.176484 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:33.176587 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:33.176655 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:33.176713 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:34.471558 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:34.655457 55086 iamrole.go:89] ListRoles: { } I0518 19:58:34.657509 55086 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0518 19:58:34.657821 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } W0518 19:58:34.657986 55086 api.go:53] PageSize not implemented I0518 19:58:34.658040 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0518 19:58:34.658253 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0518 19:58:34.658363 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0518 19:58:34.658424 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.658464 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:34.658529 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0518 19:58:34.658591 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0518 19:58:34.659303 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0518 19:58:34.659672 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.659784 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:34.659815 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:34.659879 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:34.661392 55086 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0518 19:58:34.661551 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0518 19:58:34.661578 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.661678 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:34.661750 55086 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0518 19:58:34.661740 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0518 19:58:34.661860 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0518 19:58:34.661720 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0518 19:58:34.661873 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0518 19:58:34.661960 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:34.661974 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:34.662022 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0518 19:58:34.662021 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0518 19:58:34.662205 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:34.662270 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.662403 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0518 19:58:34.662547 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:34.662603 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:34.662677 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:34.662781 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:34.662869 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.663002 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:34.663069 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:34.663218 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.663392 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.663531 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:34.663685 55086 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0518 19:58:34.663990 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] }] } I0518 19:58:34.664220 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0518 19:58:34.664477 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:34.664583 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:34.664668 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:34.664752 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:34.665143 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:34.665319 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:34.665473 55086 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0518 19:58:34.665546 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:34.665583 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:34.665660 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:34.665681 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:34.665718 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:34.665754 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:34.665796 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0518 19:58:34.665833 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0518 19:58:34.665868 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0518 19:58:34.665961 55086 api.go:53] PageSize not implemented I0518 19:58:34.666014 55086 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0518 19:58:34.666075 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:34.666131 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:34.666114 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:34.666191 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:34.666152 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:34.666220 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:34.666252 55086 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0518 19:58:34.666270 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:34.666295 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:34.666425 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:34.666501 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:34.666535 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:34.666635 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0518 19:58:34.666688 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:34.671711 55086 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0518 19:58:34.671874 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:34.672071 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:34.672223 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:34.672455 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:34.673880 55086 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0518 19:58:34.674361 55086 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0518 19:58:34.674862 55086 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0518 19:58:34.675166 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0518 19:58:34.675234 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:34.675293 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0518 19:58:34.675338 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:34.675375 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0518 19:58:34.675415 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0518 19:58:34.675457 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:34.675495 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0518 19:58:34.675550 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0518 19:58:34.675600 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:58:34.675633 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:58:34.675670 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:34.675724 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0518 19:58:34.675805 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0518 19:58:34.675880 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:34.675936 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:34.675982 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:34.676033 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:34.676077 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:34.676121 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:34.676159 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0518 19:58:34.676216 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:58:34.676251 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0518 19:58:34.676295 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:34.676346 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:34.676397 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:58:34.676448 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0518 19:58:34.680320 55086 delete_cluster.go:128] Looking for cloud resources to delete W0518 19:58:34.680395 55086 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0518 19:58:34.680419 55086 keypairs.go:95] DescribeKeyPairs: { } I0518 19:58:34.680458 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.680525 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0518 19:58:34.680589 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.680647 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.680700 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.680760 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.680805 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.680851 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0518 19:58:34.680907 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.680977 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0518 19:58:34.681040 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W0518 19:58:34.681102 55086 api.go:53] PageSize not implemented I0518 19:58:34.681114 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:34.681153 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:34.681173 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0518 19:58:34.681216 55086 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0518 19:58:34.681241 55086 targetgroups.go:35] PageSize not implemented I0518 19:58:34.681259 55086 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" ] } I0518 19:58:34.681325 55086 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0518 19:58:34.681363 55086 iamrole.go:89] ListRoles: { } I0518 19:58:34.681407 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:34.681435 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:34.681479 55086 internetgateways.go:101] DescribeInternetGateways: { } I0518 19:58:34.681531 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:34.681579 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } autoscaling-config:lt-1 ok I0518 19:58:34.682136 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0518 19:58:34.682181 55086 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4 ok autoscaling-group:nodes.complex.example.com ok I0518 19:58:34.682207 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } autoscaling-group:master-us-test-1a.masters.complex.example.com ok I0518 19:58:34.682235 55086 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0518 19:58:34.682199 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok I0518 19:58:34.682258 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok I0518 19:58:34.682312 55086 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5 ok I0518 19:58:34.682349 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0518 19:58:34.682415 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } iam-instance-profile:masters.complex.example.com ok I0518 19:58:34.682303 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.complex.example.com. ok I0518 19:58:34.682283 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 } ] } W0518 19:58:34.682577 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:34.682608 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0518 19:58:34.682664 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0518 19:58:34.682731 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0518 19:58:34.682792 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0518 19:58:34.682838 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:34.682892 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0518 19:58:34.682923 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:34.682972 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 } ] } W0518 19:58:34.683169 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:34.683192 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0518 19:58:34.683238 55086 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0518 19:58:34.683294 55086 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0518 19:58:34.683377 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0518 19:58:34.683410 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I0518 19:58:34.683449 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0518 19:58:34.683484 55086 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I0518 19:58:34.683495 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0518 19:58:34.683544 55086 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I0518 19:58:34.683587 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I0518 19:58:34.683612 55086 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I0518 19:58:34.683620 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0518 19:58:34.683665 55086 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I0518 19:58:34.683738 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0518 19:58:34.683830 55086 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0518 19:58:34.683918 55086 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (15.13s) === RUN TestLifecycleExternalLB I0518 19:58:34.684408 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:58:34.684551 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:58:34.684591 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:58:34.684631 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:58:34.684673 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:58:34.684722 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:58:34.684763 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:58:34.684793 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:58:34.684834 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:58:34.684861 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I0518 19:58:34.710487 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:34.713667 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:34.713772 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:36.011221 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:36.163976 55086 iamrole.go:89] ListRoles: { } I0518 19:58:36.165189 55086 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0518 19:58:36.165534 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I0518 19:58:36.165624 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:36.165669 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } W0518 19:58:36.165762 55086 api.go:53] PageSize not implemented I0518 19:58:36.165804 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:36.165843 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0518 19:58:36.165916 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0518 19:58:36.165950 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0518 19:58:36.165978 55086 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0518 19:58:36.166109 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:36.166173 55086 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0518 19:58:36.167644 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0518 19:58:36.167731 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0518 19:58:36.167758 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0518 19:58:36.167742 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W0518 19:58:36.167935 55086 api.go:53] PageSize not implemented I0518 19:58:36.167632 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:36.168269 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0518 19:58:36.168391 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0518 19:58:36.168436 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0518 19:58:36.168311 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I0518 19:58:36.168264 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:36.168513 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] } I0518 19:58:36.168691 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:36.169157 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:36.169271 55086 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0518 19:58:36.169408 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0518 19:58:36.169455 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0518 19:58:36.169508 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } W0518 19:58:36.169595 55086 api.go:53] PageSize not implemented I0518 19:58:36.169584 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:36.169861 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] }] } I0518 19:58:36.170689 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:36.171672 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:36.172095 55086 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0518 19:58:36.172822 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0518 19:58:36.173109 55086 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0518 19:58:36.173090 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0518 19:58:36.173180 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0518 19:58:36.173256 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0518 19:58:36.173217 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0518 19:58:36.173346 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0518 19:58:36.173475 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0518 19:58:36.173546 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:36.173778 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:36.173927 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:36.173990 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:36.174235 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:36.174467 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0518 19:58:36.174585 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:36.174703 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], VpcId: "vpc-1" } I0518 19:58:36.174766 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] }] } I0518 19:58:36.174942 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0518 19:58:36.175127 55086 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0518 19:58:36.175083 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0518 19:58:36.175230 55086 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0518 19:58:36.175362 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:36.175074 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0518 19:58:36.175468 55086 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0518 19:58:36.175684 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:36.175793 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:36.175901 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:36.176000 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:36.176073 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:36.176123 55086 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0518 19:58:36.179591 55086 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0518 19:58:36.179896 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:36.180064 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" }] }] } I0518 19:58:36.180263 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:36.180409 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0518 19:58:36.180470 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0518 19:58:36.180684 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0518 19:58:36.180898 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" }] }] } I0518 19:58:36.181080 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:36.181231 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0518 19:58:36.181276 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0518 19:58:36.181422 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0518 19:58:36.181485 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0518 19:58:36.181610 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0518 19:58:36.181747 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0518 19:58:36.181875 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0518 19:58:36.182024 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0518 19:58:36.182069 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0518 19:58:36.182195 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:36.182299 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:36.182446 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0518 19:58:36.182649 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:36.182758 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:36.182859 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0518 19:58:36.183018 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0518 19:58:36.183163 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0518 19:58:36.183467 55086 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0518 19:58:36.183756 55086 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0518 19:58:36.184138 55086 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0518 19:58:36.184207 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:36.184251 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:36.184320 55086 dns.go:235] Pre-creating DNS records I0518 19:58:36.184369 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:36.190367 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:36.193311 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:36.193408 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:37.483519 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:37.654541 55086 iamrole.go:89] ListRoles: { } I0518 19:58:37.656194 55086 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0518 19:58:37.656486 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W0518 19:58:37.656725 55086 api.go:53] PageSize not implemented I0518 19:58:37.656709 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:37.657045 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W0518 19:58:37.657207 55086 api.go:53] PageSize not implemented I0518 19:58:37.657312 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0518 19:58:37.657398 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0518 19:58:37.657434 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0518 19:58:37.657964 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0518 19:58:37.658044 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0518 19:58:37.658073 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } W0518 19:58:37.658290 55086 api.go:53] PageSize not implemented I0518 19:58:37.658222 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.658587 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.658673 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:37.658702 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:37.658740 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:37.658845 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0518 19:58:37.658954 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0518 19:58:37.658979 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0518 19:58:37.659394 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.660512 55086 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0518 19:58:37.660672 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0518 19:58:37.660682 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.660817 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:37.660883 55086 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0518 19:58:37.660920 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:37.661026 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I0518 19:58:37.661171 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0518 19:58:37.661337 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:37.661393 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.661586 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:37.661650 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0518 19:58:37.661845 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:37.666167 55086 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0518 19:58:37.666324 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:37.666437 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:37.666609 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:37.666874 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:37.667080 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:37.667400 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:37.667657 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:37.667798 55086 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0518 19:58:37.668103 55086 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0518 19:58:37.668309 55086 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0518 19:58:37.671346 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0518 19:58:37.671413 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:37.671455 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0518 19:58:37.671494 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:37.671525 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0518 19:58:37.671553 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0518 19:58:37.671583 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:37.671617 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0518 19:58:37.671653 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0518 19:58:37.671694 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0518 19:58:37.671739 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:58:37.671768 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:58:37.671803 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:37.671859 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0518 19:58:37.671894 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:37.671929 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:37.671963 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:37.672002 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:37.672033 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:58:37.672064 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0518 19:58:37.672095 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:37.672128 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:37.672164 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:58:37.672196 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0518 19:58:37.673500 55086 delete_cluster.go:128] Looking for cloud resources to delete W0518 19:58:37.673562 55086 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0518 19:58:37.673583 55086 keypairs.go:95] DescribeKeyPairs: { } I0518 19:58:37.673631 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.673688 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0518 19:58:37.673748 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.673815 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.673872 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.673926 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.673979 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.674027 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0518 19:58:37.674083 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.674142 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0518 19:58:37.674188 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W0518 19:58:37.674252 55086 api.go:53] PageSize not implemented I0518 19:58:37.674273 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:37.674303 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:37.674326 55086 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0518 19:58:37.674391 55086 targetgroups.go:35] PageSize not implemented I0518 19:58:37.674413 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0518 19:58:37.674467 55086 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0518 19:58:37.674508 55086 iamrole.go:89] ListRoles: { } I0518 19:58:37.674550 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:37.674588 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:37.674638 55086 internetgateways.go:101] DescribeInternetGateways: { } I0518 19:58:37.674681 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:37.674722 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:37.675168 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0518 19:58:37.675231 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I0518 19:58:37.675185 55086 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } iam-instance-profile:masters.externallb.example.com ok keypair:key-1 ok autoscaling-group:nodes.externallb.example.com ok I0518 19:58:37.675288 55086 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } autoscaling-config:lt-2 ok autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I0518 19:58:37.675329 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0518 19:58:37.675397 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok I0518 19:58:37.675377 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0518 19:58:37.675281 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.externallb.example.com. ok I0518 19:58:37.675455 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:37.675558 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0518 19:58:37.675707 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:37.675731 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0518 19:58:37.675773 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I0518 19:58:37.675833 55086 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0518 19:58:37.675894 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:37.675946 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0518 19:58:37.676029 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:37.676044 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0518 19:58:37.676144 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I0518 19:58:37.676211 55086 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I0518 19:58:37.676230 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0518 19:58:37.676206 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0518 19:58:37.676279 55086 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I0518 19:58:37.676334 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I0518 19:58:37.676426 55086 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I0518 19:58:37.676445 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0518 19:58:37.676488 55086 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I0518 19:58:37.676583 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0518 19:58:37.676677 55086 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0518 19:58:37.676760 55086 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (2.99s) === RUN TestLifecycleSharedSubnet I0518 19:58:37.677271 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:58:37.677419 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:58:37.677457 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:58:37.677505 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:58:37.677556 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:58:37.677617 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:58:37.677661 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:58:37.677756 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:58:37.677801 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:58:37.677830 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I0518 19:58:37.703242 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:37.708326 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:37.708431 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:39.034190 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:39.208712 55086 iamrole.go:89] ListRoles: { } I0518 19:58:39.209811 55086 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0518 19:58:39.210364 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0518 19:58:39.210519 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedsubnet.example.com" }] } I0518 19:58:39.210618 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0518 19:58:39.210682 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0518 19:58:39.211481 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] }] } I0518 19:58:39.211644 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:39.211797 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:39.212681 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:58:39.212755 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0518 19:58:39.212780 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0518 19:58:39.213029 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:39.213656 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:39.213787 55086 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0518 19:58:39.213905 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] }] } I0518 19:58:39.214021 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:39.214107 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:39.214832 55086 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0518 19:58:39.215067 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0518 19:58:39.215126 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0518 19:58:39.215264 55086 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0518 19:58:39.215404 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0518 19:58:39.215277 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0518 19:58:39.215577 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0518 19:58:39.215599 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0518 19:58:39.215665 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:39.215755 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:39.215808 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0518 19:58:39.215812 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:58:39.215965 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0518 19:58:39.216278 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:39.216372 55086 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] } I0518 19:58:39.216495 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0518 19:58:39.216605 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:39.216670 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:39.217473 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0518 19:58:39.220709 55086 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0518 19:58:39.220938 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0518 19:58:39.221216 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0518 19:58:39.221402 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:39.221536 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:39.221768 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" }] }] } I0518 19:58:39.222072 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:39.222213 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0518 19:58:39.222426 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0518 19:58:39.222589 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0518 19:58:39.222768 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0518 19:58:39.222935 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0518 19:58:39.223168 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:39.223328 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" }] }] } I0518 19:58:39.224400 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0518 19:58:39.224649 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0518 19:58:39.225082 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0518 19:58:39.225389 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0518 19:58:39.225669 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0518 19:58:39.226095 55086 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0518 19:58:39.226635 55086 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0518 19:58:39.227489 55086 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0518 19:58:39.228527 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:39.228901 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:39.229001 55086 dns.go:235] Pre-creating DNS records I0518 19:58:39.229033 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:39.235434 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:39.238568 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:39.238654 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:40.521678 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:40.680881 55086 iamrole.go:89] ListRoles: { } I0518 19:58:40.682260 55086 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0518 19:58:40.682474 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0518 19:58:40.682727 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0518 19:58:40.682887 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:40.683303 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:40.684057 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:58:40.684169 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0518 19:58:40.684206 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0518 19:58:40.685367 55086 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0518 19:58:40.685534 55086 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0518 19:58:40.685530 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0518 19:58:40.685611 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0518 19:58:40.685638 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0518 19:58:40.685767 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:40.685816 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:58:40.685924 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0518 19:58:40.686062 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:40.688809 55086 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0518 19:58:40.688974 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:40.689102 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:40.689205 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:40.689404 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:40.690156 55086 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0518 19:58:40.690359 55086 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0518 19:58:40.690568 55086 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0518 19:58:40.692160 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0518 19:58:40.692201 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0518 19:58:40.692223 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:40.692241 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0518 19:58:40.692261 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0518 19:58:40.692280 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0518 19:58:40.692300 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0518 19:58:40.692323 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0518 19:58:40.692348 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:58:40.692365 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:58:40.692382 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0518 19:58:40.692399 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:40.692417 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:40.692435 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:40.692456 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:58:40.692473 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0518 19:58:40.692490 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:40.692508 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:40.692527 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0518 19:58:40.693277 55086 delete_cluster.go:128] Looking for cloud resources to delete W0518 19:58:40.693317 55086 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0518 19:58:40.693330 55086 keypairs.go:95] DescribeKeyPairs: { } I0518 19:58:40.693352 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0518 19:58:40.693379 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0518 19:58:40.693413 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0518 19:58:40.693446 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0518 19:58:40.693469 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0518 19:58:40.693492 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0518 19:58:40.693517 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0518 19:58:40.693537 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0518 19:58:40.693560 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0518 19:58:40.693600 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0518 19:58:40.693622 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W0518 19:58:40.693651 55086 api.go:53] PageSize not implemented I0518 19:58:40.693664 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:40.693680 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:40.693692 55086 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0518 19:58:40.693705 55086 targetgroups.go:35] PageSize not implemented I0518 19:58:40.693717 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0518 19:58:40.693747 55086 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0518 19:58:40.693771 55086 iamrole.go:89] ListRoles: { } I0518 19:58:40.693799 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:40.693818 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:40.693844 55086 internetgateways.go:101] DescribeInternetGateways: { } I0518 19:58:40.693866 55086 routetable.go:53] DescribeRouteTables: { } autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok autoscaling-group:nodes.sharedsubnet.example.com ok I0518 19:58:40.694083 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0518 19:58:40.694129 55086 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0518 19:58:40.694164 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:40.694193 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0518 19:58:40.694307 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:40.694317 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0518 19:58:40.694283 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0518 19:58:40.694350 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:40.694390 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok I0518 19:58:40.694399 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0518 19:58:40.694449 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } W0518 19:58:40.694488 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:40.694499 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0518 19:58:40.694501 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } autoscaling-config:lt-2 ok iam-instance-profile:nodes.sharedsubnet.example.com ok I0518 19:58:40.694532 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } autoscaling-config:lt-1 ok I0518 19:58:40.694450 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.sharedsubnet.example.com. ok volume:vol-2 ok I0518 19:58:40.694598 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I0518 19:58:40.694633 55086 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0518 19:58:40.694643 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0518 19:58:40.694662 55086 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok I0518 19:58:40.694680 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I0518 19:58:40.694703 55086 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0518 19:58:40.694710 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0518 19:58:40.694726 55086 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (3.02s) === RUN TestLifecyclePrivateSharedSubnet I0518 19:58:40.694997 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:58:40.695076 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:58:40.695098 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:58:40.695123 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:58:40.695147 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:58:40.695179 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:58:40.695204 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:58:40.695220 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:58:40.695241 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:58:40.695257 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I0518 19:58:40.711555 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:40.713572 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:40.713625 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:40.713660 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:41.985426 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:42.149856 55086 iamrole.go:89] ListRoles: { } I0518 19:58:42.151876 55086 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0518 19:58:42.152187 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:42.152549 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0518 19:58:42.152624 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0518 19:58:42.152712 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0518 19:58:42.152756 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0518 19:58:42.152908 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:42.153108 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:42.153277 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:42.153332 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:58:42.153409 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0518 19:58:42.153327 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0518 19:58:42.153485 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0518 19:58:42.153446 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0518 19:58:42.153586 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:42.153714 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:42.153819 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:42.153859 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:42.153958 55086 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.156053 55086 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0518 19:58:42.156218 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:58:42.156331 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0518 19:58:42.156427 55086 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0518 19:58:42.156389 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0518 19:58:42.156487 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0518 19:58:42.156573 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0518 19:58:42.156531 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0518 19:58:42.156594 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0518 19:58:42.156814 55086 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0518 19:58:42.156815 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0518 19:58:42.156920 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:42.156828 55086 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0518 19:58:42.156973 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0518 19:58:42.157037 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0518 19:58:42.156972 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:42.157044 55086 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0518 19:58:42.157124 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0518 19:58:42.157289 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0518 19:58:42.157337 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0518 19:58:42.157499 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:58:42.157556 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0518 19:58:42.157686 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0518 19:58:42.157819 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0518 19:58:42.157917 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:42.157964 55086 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/role/internal-elb", Value: "1" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" }] } I0518 19:58:42.158037 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0518 19:58:42.158128 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:42.158177 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:42.158226 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0518 19:58:42.158313 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0518 19:58:42.158357 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:42.158396 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:42.158449 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:42.158487 55086 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/role/elb", Value: "1" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" }] } I0518 19:58:42.158840 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0518 19:58:42.159223 55086 executor.go:111] Tasks: 72 done / 123 total; 31 can run W0518 19:58:42.159533 55086 api.go:53] PageSize not implemented I0518 19:58:42.159404 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0518 19:58:42.159602 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:42.159731 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:42.159697 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:42.159788 55086 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0518 19:58:42.159831 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:42.159881 55086 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0518 19:58:42.159779 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.159939 55086 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0518 19:58:42.159909 55086 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I0518 19:58:42.160003 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.160202 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0518 19:58:42.160426 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0518 19:58:42.160719 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0518 19:58:42.160945 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.161159 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.161348 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0518 19:58:42.161423 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0518 19:58:42.161476 55086 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } W0518 19:58:42.161596 55086 api.go:53] PageSize not implemented I0518 19:58:42.161622 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:42.161565 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.161781 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I0518 19:58:42.161945 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.162106 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:42.162250 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:42.162375 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0518 19:58:42.162530 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.162712 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0518 19:58:42.162878 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.163054 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I0518 19:58:42.163190 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.163351 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0518 19:58:42.163473 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0518 19:58:42.163632 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0518 19:58:42.163790 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.163947 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0518 19:58:42.164113 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0518 19:58:42.164354 55086 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0518 19:58:42.164439 55086 api.go:53] PageSize not implemented I0518 19:58:42.164492 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:42.164545 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0518 19:58:42.164646 55086 api.go:53] PageSize not implemented I0518 19:58:42.164707 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:42.164732 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:42.164915 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:42.165050 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:42.169908 55086 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0518 19:58:42.170092 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:42.170167 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:42.170335 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:42.170465 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:42.171290 55086 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0518 19:58:42.171601 55086 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0518 19:58:42.171981 55086 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0518 19:58:42.172056 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:42.172122 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:42.172225 55086 dns.go:235] Pre-creating DNS records I0518 19:58:42.172269 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:42.178804 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:42.182454 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:42.182568 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:42.182667 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:43.467576 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:43.620466 55086 iamrole.go:89] ListRoles: { } I0518 19:58:43.622399 55086 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0518 19:58:43.622945 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:43.623008 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:43.623175 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:43.623291 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:43.623564 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:58:43.623638 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0518 19:58:43.623660 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0518 19:58:43.625718 55086 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0518 19:58:43.626015 55086 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0518 19:58:43.625898 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0518 19:58:43.626174 55086 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0518 19:58:43.626178 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:43.626203 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0518 19:58:43.626296 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0518 19:58:43.626264 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0518 19:58:43.626344 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0518 19:58:43.626273 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0518 19:58:43.626505 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0518 19:58:43.626672 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:43.626733 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0518 19:58:43.626953 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:43.627025 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:58:43.627137 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0518 19:58:43.627305 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:43.627360 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0518 19:58:43.627557 55086 executor.go:111] Tasks: 72 done / 123 total; 31 can run W0518 19:58:43.627697 55086 api.go:53] PageSize not implemented I0518 19:58:43.627740 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:43.627836 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:43.627877 55086 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0518 19:58:43.627881 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:43.627969 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:43.627982 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:43.628037 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:43.628052 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0518 19:58:43.628084 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0518 19:58:43.628109 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0518 19:58:43.628137 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0518 19:58:43.628163 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } W0518 19:58:43.628230 55086 api.go:53] PageSize not implemented I0518 19:58:43.628246 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:43.628485 55086 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0518 19:58:43.628564 55086 api.go:53] PageSize not implemented I0518 19:58:43.628595 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:43.628635 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:43.628675 55086 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0518 19:58:43.628709 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:43.628753 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:43.628806 55086 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0518 19:58:43.628830 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W0518 19:58:43.628939 55086 api.go:53] PageSize not implemented I0518 19:58:43.628977 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:43.634406 55086 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0518 19:58:43.634547 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:43.634709 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:43.634864 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:43.635018 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:43.635704 55086 executor.go:111] Tasks: 115 done / 123 total; 2 can run W0518 19:58:43.635799 55086 api.go:53] PageSize not implemented I0518 19:58:43.635823 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:43.636009 55086 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0518 19:58:43.636234 55086 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0518 19:58:43.639414 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0518 19:58:43.639481 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0518 19:58:43.639517 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:43.639556 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0518 19:58:43.639598 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0518 19:58:43.639632 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0518 19:58:43.639676 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0518 19:58:43.639722 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0518 19:58:43.639761 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0518 19:58:43.639802 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:58:43.639838 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:58:43.639873 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0518 19:58:43.639908 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:43.639942 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:43.639986 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:43.640020 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0518 19:58:43.640062 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:43.640094 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:58:43.640127 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0518 19:58:43.640158 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:43.640194 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:43.640227 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0518 19:58:43.641698 55086 delete_cluster.go:128] Looking for cloud resources to delete W0518 19:58:43.641767 55086 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0518 19:58:43.641789 55086 keypairs.go:95] DescribeKeyPairs: { } I0518 19:58:43.641831 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:43.641885 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0518 19:58:43.641970 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:43.642034 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:43.642083 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:43.642132 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:43.642184 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:43.642218 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0518 19:58:43.642264 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:43.642315 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0518 19:58:43.642361 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W0518 19:58:43.642400 55086 api.go:53] PageSize not implemented I0518 19:58:43.642428 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0518 19:58:43.642472 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:43.642499 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:43.642516 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0518 19:58:43.642553 55086 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0518 19:58:43.642578 55086 targetgroups.go:35] PageSize not implemented I0518 19:58:43.642595 55086 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" ] } I0518 19:58:43.642654 55086 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0518 19:58:43.642698 55086 iamrole.go:89] ListRoles: { } I0518 19:58:43.642745 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:43.642775 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:43.642817 55086 internetgateways.go:101] DescribeInternetGateways: { } I0518 19:58:43.642858 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:43.643332 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:43.643350 55086 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok autoscaling-group:bastion.private-shared-subnet.example.com ok I0518 19:58:43.643412 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I0518 19:58:43.643489 55086 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } autoscaling-group:nodes.private-shared-subnet.example.com ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I0518 19:58:43.643349 55086 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } load-balancer:api-private-shared-subnet-n2f8ak ok W0518 19:58:43.643550 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:43.643683 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0518 19:58:43.643647 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0518 19:58:43.643739 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } iam-instance-profile:nodes.private-shared-subnet.example.com ok I0518 19:58:43.643403 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.private-shared-subnet.example.com. ok I0518 19:58:43.643772 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0518 19:58:43.643725 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:43.643811 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I0518 19:58:43.643906 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0518 19:58:43.644000 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok I0518 19:58:43.643872 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W0518 19:58:43.644532 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:43.644569 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0518 19:58:43.644636 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-3 ok I0518 19:58:43.644752 55086 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I0518 19:58:43.644836 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:43.644896 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0518 19:58:43.645170 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:43.645217 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0518 19:58:43.645306 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0518 19:58:43.645414 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:43.645430 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I0518 19:58:43.645506 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I0518 19:58:43.645575 55086 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0518 19:58:43.645594 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0518 19:58:43.645503 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I0518 19:58:43.645630 55086 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } W0518 19:58:43.645644 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-role:bastions.private-shared-subnet.example.com ok I0518 19:58:43.645670 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0518 19:58:43.645676 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I0518 19:58:43.645766 55086 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0518 19:58:43.645793 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0518 19:58:43.645836 55086 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok I0518 19:58:43.645889 55086 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0518 19:58:43.645907 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0518 19:58:43.645939 55086 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (2.95s) === RUN TestLifecyclePrivateSharedIP I0518 19:58:43.646407 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:58:43.646541 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:58:43.646581 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:58:43.646622 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:58:43.646663 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:58:43.646712 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:58:43.646752 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:58:43.646782 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:58:43.646820 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:58:43.646847 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I0518 19:58:43.674168 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:43.677598 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:43.677704 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:43.677782 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:45.034757 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:45.188396 55086 iamrole.go:89] ListRoles: { } I0518 19:58:45.190501 55086 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0518 19:58:45.190890 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:45.190993 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:45.191131 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:45.191286 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:45.191304 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I0518 19:58:45.191377 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:45.191382 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0518 19:58:45.191411 55086 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0518 19:58:45.191498 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:58:45.191542 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0518 19:58:45.191559 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0518 19:58:45.192758 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0518 19:58:45.192838 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0518 19:58:45.192929 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0518 19:58:45.192907 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:45.192969 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0518 19:58:45.193026 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:45.193121 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:45.194734 55086 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0518 19:58:45.194910 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:45.194972 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0518 19:58:45.195003 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0518 19:58:45.195082 55086 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0518 19:58:45.195037 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0518 19:58:45.195079 55086 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0518 19:58:45.195122 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0518 19:58:45.195155 55086 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0518 19:58:45.195131 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:45.195100 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-12345678" } I0518 19:58:45.195171 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0518 19:58:45.195215 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0518 19:58:45.195250 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0518 19:58:45.195253 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0518 19:58:45.195290 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0518 19:58:45.195314 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0518 19:58:45.195342 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:45.195368 55086 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0518 19:58:45.195350 55086 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0518 19:58:45.195429 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:45.195456 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:45.195440 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0518 19:58:45.195491 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0518 19:58:45.195556 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:45.195587 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:45.195622 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:58:45.195698 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0518 19:58:45.195811 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0518 19:58:45.195863 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:45.195888 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:45.195913 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:45.196005 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0518 19:58:45.196032 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:45.196138 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0518 19:58:45.196230 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0518 19:58:45.196265 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-12345678" } I0518 19:58:45.196292 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:45.196156 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0518 19:58:45.196326 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0518 19:58:45.196457 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:45.196522 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:45.196569 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0518 19:58:45.196593 55086 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] } I0518 19:58:45.196696 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:45.196746 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0518 19:58:45.196846 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0518 19:58:45.196871 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:45.196967 55086 executor.go:111] Tasks: 74 done / 132 total; 36 can run W0518 19:58:45.197134 55086 api.go:53] PageSize not implemented I0518 19:58:45.197097 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0518 19:58:45.197166 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0518 19:58:45.197220 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:45.197227 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:45.197299 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:45.197300 55086 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "Name", Value: "api.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0518 19:58:45.197262 55086 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0518 19:58:45.197395 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:45.197381 55086 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I0518 19:58:45.197338 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:45.197457 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:45.197499 55086 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } I0518 19:58:45.197494 55086 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0518 19:58:45.197539 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } W0518 19:58:45.197575 55086 api.go:53] PageSize not implemented I0518 19:58:45.197612 55086 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I0518 19:58:45.197643 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:45.197690 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:45.197737 55086 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0518 19:58:45.197850 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0518 19:58:45.197912 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0518 19:58:45.198047 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0518 19:58:45.198210 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:45.198350 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0518 19:58:45.198401 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0518 19:58:45.198611 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0518 19:58:45.198783 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0518 19:58:45.198926 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:45.199018 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:45.199128 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0518 19:58:45.199322 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0518 19:58:45.199446 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0518 19:58:45.199546 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0518 19:58:45.199629 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0518 19:58:45.199721 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" }] }] } I0518 19:58:45.199809 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0518 19:58:45.199896 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" }] }] } I0518 19:58:45.199987 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0518 19:58:45.200077 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" }] }] } I0518 19:58:45.200176 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0518 19:58:45.200273 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0518 19:58:45.200386 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0518 19:58:45.200456 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0518 19:58:45.200551 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0518 19:58:45.200622 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0518 19:58:45.200660 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0518 19:58:45.200689 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I0518 19:58:45.200771 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0518 19:58:45.200825 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:45.200899 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:45.200970 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0518 19:58:45.201131 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0518 19:58:45.201293 55086 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0518 19:58:45.201376 55086 api.go:53] PageSize not implemented I0518 19:58:45.201438 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:45.201401 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:45.201477 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0518 19:58:45.201540 55086 api.go:53] PageSize not implemented I0518 19:58:45.201530 55086 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:45.201583 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:45.201578 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:45.201717 55086 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0518 19:58:45.201856 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0518 19:58:45.201772 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:45.201933 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:45.201994 55086 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0518 19:58:45.201979 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:45.206530 55086 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0518 19:58:45.206622 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:45.206704 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0518 19:58:45.206782 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:45.206892 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:45.207064 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:45.207153 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:45.207586 55086 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0518 19:58:45.207799 55086 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0518 19:58:45.207998 55086 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0518 19:58:45.208039 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:45.208078 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:45.208133 55086 dns.go:235] Pre-creating DNS records I0518 19:58:45.208157 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:45.213507 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:45.217064 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:45.217173 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:45.217248 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:46.519978 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:46.666520 55086 iamrole.go:89] ListRoles: { } I0518 19:58:46.668558 55086 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0518 19:58:46.668866 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:46.668950 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:46.669152 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0518 19:58:46.669233 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0518 19:58:46.669264 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0518 19:58:46.669323 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] }] } I0518 19:58:46.671068 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:46.672468 55086 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0518 19:58:46.672711 55086 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0518 19:58:46.672739 55086 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0518 19:58:46.672762 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0518 19:58:46.672672 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0518 19:58:46.672792 55086 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0518 19:58:46.672886 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0518 19:58:46.672922 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:46.672934 55086 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0518 19:58:46.673001 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] }] } I0518 19:58:46.673184 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0518 19:58:46.673369 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:46.673437 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] }] } I0518 19:58:46.673622 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0518 19:58:46.673678 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0518 19:58:46.673787 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:46.673927 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:46.673990 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:46.674126 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0518 19:58:46.674303 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:46.674361 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0518 19:58:46.674503 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:46.674634 55086 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0518 19:58:46.674815 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:46.674867 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:46.674881 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0518 19:58:46.674909 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0518 19:58:46.674875 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:46.674931 55086 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0518 19:58:46.675063 55086 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } W0518 19:58:46.675107 55086 api.go:53] PageSize not implemented I0518 19:58:46.675118 55086 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0518 19:58:46.675126 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:46.675181 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W0518 19:58:46.675210 55086 api.go:53] PageSize not implemented I0518 19:58:46.675124 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:46.675238 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:46.675289 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:46.675364 55086 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0518 19:58:46.675500 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:46.675639 55086 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0518 19:58:46.675729 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:46.675902 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:46.676042 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:46.676424 55086 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0518 19:58:46.676512 55086 api.go:53] PageSize not implemented I0518 19:58:46.676514 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:46.676563 55086 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0518 19:58:46.676579 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:46.676555 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:46.676636 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0518 19:58:46.676675 55086 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0518 19:58:46.676668 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0518 19:58:46.676692 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W0518 19:58:46.676760 55086 api.go:53] PageSize not implemented I0518 19:58:46.676784 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:46.676860 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:46.679951 55086 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0518 19:58:46.680012 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0518 19:58:46.680126 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:46.680318 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:46.680498 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:46.680593 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:46.681116 55086 executor.go:111] Tasks: 124 done / 132 total; 2 can run W0518 19:58:46.681254 55086 api.go:53] PageSize not implemented I0518 19:58:46.681271 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:46.681394 55086 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0518 19:58:46.681609 55086 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0518 19:58:46.684822 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0518 19:58:46.684889 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0518 19:58:46.684925 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:46.684963 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0518 19:58:46.684995 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0518 19:58:46.685033 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0518 19:58:46.685071 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0518 19:58:46.685110 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0518 19:58:46.685154 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0518 19:58:46.685189 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0518 19:58:46.685224 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:58:46.685257 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:58:46.685288 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:46.685326 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0518 19:58:46.685358 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0518 19:58:46.685393 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:46.685427 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:46.685463 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0518 19:58:46.685499 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0518 19:58:46.685532 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:46.685570 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:46.685602 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0518 19:58:46.685640 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:58:46.685670 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0518 19:58:46.685702 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:46.685736 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:46.685771 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0518 19:58:46.687197 55086 delete_cluster.go:128] Looking for cloud resources to delete W0518 19:58:46.687268 55086 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0518 19:58:46.687290 55086 keypairs.go:95] DescribeKeyPairs: { } I0518 19:58:46.687336 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:46.687394 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0518 19:58:46.687463 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:46.687529 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:46.687574 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:46.687618 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:46.687662 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:46.687733 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0518 19:58:46.687790 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:46.687844 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:46.687874 55086 natgateway.go:117] DescribeNatGateways: { } I0518 19:58:46.687918 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0518 19:58:46.687953 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W0518 19:58:46.688002 55086 api.go:53] PageSize not implemented I0518 19:58:46.688019 55086 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0518 19:58:46.688063 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:46.688089 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:46.688109 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0518 19:58:46.688147 55086 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0518 19:58:46.688171 55086 targetgroups.go:35] PageSize not implemented I0518 19:58:46.688190 55086 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" ] } I0518 19:58:46.688252 55086 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0518 19:58:46.688295 55086 iamrole.go:89] ListRoles: { } I0518 19:58:46.688341 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:46.688372 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:46.688421 55086 internetgateways.go:101] DescribeInternetGateways: { } I0518 19:58:46.688465 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:46.688500 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0518 19:58:46.688540 55086 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0518 19:58:46.688576 55086 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } autoscaling-group:nodes.private-shared-ip.example.com ok autoscaling-group:bastion.private-shared-ip.example.com ok I0518 19:58:46.689155 55086 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I0518 19:58:46.689201 55086 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0518 19:58:46.689288 55086 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I0518 19:58:46.689261 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0518 19:58:46.689309 55086 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } I0518 19:58:46.689365 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } nat-gateway:nat-1 ok I0518 19:58:46.689317 55086 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } load-balancer:api-private-shared-ip-exa-ohatqj ok I0518 19:58:46.689391 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0518 19:58:46.689286 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } iam-instance-profile:nodes.private-shared-ip.example.com ok I0518 19:58:46.689422 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.private-shared-ip.example.com ok I0518 19:58:46.689404 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0518 19:58:46.689454 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0518 19:58:46.689485 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } autoscaling-config:lt-1 ok iam-instance-profile:masters.private-shared-ip.example.com ok iam-instance-profile:bastions.private-shared-ip.example.com ok I0518 19:58:46.689513 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:46.689609 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0518 19:58:46.689844 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:46.689870 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0518 19:58:46.689921 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0518 19:58:46.689979 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0518 19:58:46.690121 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:46.690150 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0518 19:58:46.690207 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-3 ok I0518 19:58:46.690313 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:46.690378 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } W0518 19:58:46.690554 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:46.690571 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0518 19:58:46.690688 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I0518 19:58:46.690772 55086 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0518 19:58:46.690688 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0518 19:58:46.690798 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0518 19:58:46.690843 55086 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok I0518 19:58:46.690856 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0518 19:58:46.690896 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I0518 19:58:46.690936 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0518 19:58:46.690984 55086 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0518 19:58:46.690989 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0518 19:58:46.691035 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } W0518 19:58:46.691076 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:46.691087 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0518 19:58:46.691096 55086 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I0518 19:58:46.691140 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I0518 19:58:46.691184 55086 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0518 19:58:46.691200 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0518 19:58:46.691229 55086 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I0518 19:58:46.691298 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0518 19:58:46.691358 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (3.05s) === RUN TestLifecycleManyAddons I0518 19:58:46.691794 55086 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:58:46.691924 55086 internetgateways.go:66] CreateInternetGateway: { } I0518 19:58:46.691962 55086 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:58:46.692003 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:58:46.692043 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:58:46.692092 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:58:46.692133 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:58:46.692163 55086 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:58:46.692201 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:58:46.692232 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0518 19:58:46.718155 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:46.721664 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:46.721748 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:48.035945 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:48.780183 55086 iamrole.go:89] ListRoles: { } I0518 19:58:48.781187 55086 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0518 19:58:48.783626 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0518 19:58:48.783721 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0518 19:58:48.784456 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:48.785018 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:48.785379 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:48.785488 55086 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0518 19:58:48.785524 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:48.785791 55086 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0518 19:58:48.785807 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:48.785866 55086 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0518 19:58:48.786446 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0518 19:58:48.786512 55086 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0518 19:58:48.786557 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:58:48.786617 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:48.786683 55086 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0518 19:58:48.786909 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:48.787000 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:48.787749 55086 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.787901 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:48.787988 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:48.788145 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:48.788319 55086 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.790123 55086 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0518 19:58:48.790229 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0518 19:58:48.790270 55086 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0518 19:58:48.790247 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:48.790352 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0518 19:58:48.790357 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:48.790563 55086 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0518 19:58:48.790520 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0518 19:58:48.790764 55086 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0518 19:58:48.790826 55086 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.790835 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0518 19:58:48.790899 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:48.790940 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0518 19:58:48.791027 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0518 19:58:48.791090 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:48.791146 55086 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], VpcId: "vpc-1" } I0518 19:58:48.791209 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:48.791240 55086 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] } I0518 19:58:48.791303 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0518 19:58:48.791452 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" }] }], VpcId: "vpc-1" } I0518 19:58:48.791516 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:48.791553 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:48.791585 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:48.791715 55086 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0518 19:58:48.791749 55086 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }], VpcId: "vpc-1" } I0518 19:58:48.791888 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:48.791955 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:48.792005 55086 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0518 19:58:48.792072 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:48.792126 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:48.792345 55086 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0518 19:58:48.796196 55086 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0518 19:58:48.796400 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:48.796507 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:48.796736 55086 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0518 19:58:48.796811 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0518 19:58:48.797005 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0518 19:58:48.797226 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.797367 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.797575 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0518 19:58:48.797748 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.797906 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0518 19:58:48.797952 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.798110 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:48.798211 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.798375 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.798513 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.798658 55086 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0518 19:58:48.798699 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.798829 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.798959 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:48.799061 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:48.799165 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.799371 55086 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0518 19:58:48.799518 55086 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0518 19:58:48.799622 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:48.799721 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:48.799827 55086 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0518 19:58:48.800155 55086 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0518 19:58:48.800428 55086 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0518 19:58:48.800703 55086 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0518 19:58:48.800751 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:48.800782 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:48.800832 55086 dns.go:235] Pre-creating DNS records I0518 19:58:48.800855 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:48.805339 55086 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0518 19:58:48.807880 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:48.807945 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:50.120705 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:50.802173 55086 iamrole.go:89] ListRoles: { } I0518 19:58:50.803179 55086 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0518 19:58:50.803481 55086 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0518 19:58:50.803660 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.803863 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.804011 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.804111 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:58:50.804145 55086 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:58:50.804202 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:50.804240 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.804827 55086 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0518 19:58:50.805829 55086 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0518 19:58:50.806039 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0518 19:58:50.806156 55086 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0518 19:58:50.806195 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:50.806275 55086 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0518 19:58:50.806307 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.806451 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.806578 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.806716 55086 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:58:50.806761 55086 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:58:50.806847 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0518 19:58:50.806986 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0518 19:58:50.807085 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:50.809337 55086 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0518 19:58:50.809482 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:50.809588 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:50.809687 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:50.809769 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:50.809943 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0518 19:58:50.810096 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:50.810174 55086 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0518 19:58:50.810561 55086 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0518 19:58:50.810697 55086 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0518 19:58:50.810856 55086 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0518 19:58:50.812554 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0518 19:58:50.812594 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0518 19:58:50.812617 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0518 19:58:50.812638 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0518 19:58:50.812658 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0518 19:58:50.812675 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0518 19:58:50.812691 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0518 19:58:50.812710 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0518 19:58:50.812730 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0518 19:58:50.812750 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0518 19:58:50.812773 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0518 19:58:50.812789 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0518 19:58:50.812807 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0518 19:58:50.812825 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0518 19:58:50.812841 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:58:50.812861 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0518 19:58:50.812880 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:58:50.812901 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0518 19:58:50.812917 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0518 19:58:50.812932 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0518 19:58:50.812950 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0518 19:58:50.812970 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0518 19:58:50.812990 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:58:50.813009 55086 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0518 19:58:50.813942 55086 delete_cluster.go:128] Looking for cloud resources to delete W0518 19:58:50.813980 55086 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0518 19:58:50.813991 55086 keypairs.go:95] DescribeKeyPairs: { } I0518 19:58:50.814017 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.814049 55086 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0518 19:58:50.814083 55086 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.814120 55086 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.814148 55086 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.814181 55086 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.814207 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.814231 55086 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0518 19:58:50.814259 55086 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.814291 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0518 19:58:50.814315 55086 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0518 19:58:50.814353 55086 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0518 19:58:50.814375 55086 api.go:53] PageSize not implemented I0518 19:58:50.814388 55086 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0518 19:58:50.814405 55086 loadbalancers.go:35] PageSize not implemented I0518 19:58:50.814417 55086 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0518 19:58:50.814431 55086 targetgroups.go:35] PageSize not implemented I0518 19:58:50.814444 55086 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0518 19:58:50.814475 55086 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0518 19:58:50.814499 55086 iamrole.go:89] ListRoles: { } I0518 19:58:50.814528 55086 zones.go:93] ListHostedZonesPages { } I0518 19:58:50.814547 55086 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:50.814574 55086 internetgateways.go:101] DescribeInternetGateways: { } I0518 19:58:50.814600 55086 routetable.go:53] DescribeRouteTables: { } I0518 19:58:50.814620 55086 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0518 19:58:50.814879 55086 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0518 19:58:50.814928 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.minimal.example.com ok I0518 19:58:50.814959 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0518 19:58:50.815034 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:50.815046 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0518 19:58:50.814993 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0518 19:58:50.815069 55086 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0518 19:58:50.815076 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0518 19:58:50.815107 55086 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0518 19:58:50.815139 55086 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0518 19:58:50.814994 55086 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0518 19:58:50.815096 55086 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } route53-record:Z1AFAKE1ZON3YO/A/api.minimal.example.com. ok W0518 19:58:50.815212 55086 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0518 19:58:50.815220 55086 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0518 19:58:50.815241 55086 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0518 19:58:50.815274 55086 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0518 19:58:50.815301 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0518 19:58:50.815335 55086 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0518 19:58:50.815403 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0518 19:58:50.815432 55086 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0518 19:58:50.815442 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0518 19:58:50.815464 55086 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0518 19:58:50.815461 55086 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0518 19:58:50.815482 55086 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0518 19:58:50.815521 55086 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0518 19:58:50.815533 55086 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0518 19:58:50.815558 55086 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0518 19:58:50.815600 55086 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0518 19:58:50.815649 55086 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0518 19:58:50.815693 55086 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (4.12s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 214.433s === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.012s === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I0518 19:55:22.193859 55510 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.005s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I0518 19:55:22.222720 55512 pod.go:59] starting pod controller I0518 19:55:22.222991 55512 stoppable.go:62] shutting down controller I0518 19:55:22.223062 55512 pod.go:107] Got stop signal --- PASS: TestPodController (0.00s) PASS I0518 19:55:22.223151 55512 pod.go:65] shutting down pod controller ok k8s.io/kops/dns-controller/pkg/watchers 0.036s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000354b0} route53_test.go:93: Got zone list: [0xc0000354e0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c0f0} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035610} route53_test.go:93: Got zone list: [0xc000035640] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c108} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc000035740} route53_test.go:170: Successfully added managed DNS zone: &{0xc0003ef230 0xc00009c128} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035900} route53_test.go:93: Got zone list: [0xc000035930] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c148} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035a90} route53_test.go:93: Got zone list: [0xc000035ac0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c170} route53_test.go:187: Successfully added resource record set: {0xc0003edef0 0xc00009c190} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035da0} route53_test.go:93: Got zone list: [0xc000035dd0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c220} route53_test.go:199: Successfully added resource record set: {0xc00040c120 0xc00009c240} route53_test.go:118: Got 1 recordsets: [0xc000035f70] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000410180} route53_test.go:93: Got zone list: [0xc0004101b0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c2e0} route53_test.go:221: Successfully added resource record set: {0xc00040c2d0 0xc00009c300} route53_test.go:228: Correctly failed to add duplicate resource record {0xc00040c2d0 0xc00009c300}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000410570} route53_test.go:93: Got zone list: [0xc0004105a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c3c0} route53_test.go:246: Successfully removed resource set {0xc00040c510 0xc00009c3e0} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000410880} route53_test.go:93: Got zone list: [0xc0004108b0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c470} route53_test.go:264: Successfully removed resource set {0xc00040c6c0 0xc00009c490} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000410bc0} route53_test.go:93: Got zone list: [0xc000410bf0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c528} commontests.go:192: Successfully added resource record set: {0xc00040c870 0xc00009c548} commontests.go:45: Correctly replaced resource record {0xc00040c870 0xc00009c548} -> {0xc00040c990 0xc00009c598} commontests.go:142: Got 1 recordsets: [0xc000410f00] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000411130} route53_test.go:93: Got zone list: [0xc000411160] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c650} commontests.go:192: Successfully added resource record set: {0xc00040cc60 0xc00009c670} commontests.go:70: Correctly replaced resource record {0xc00040cc60 0xc00009c670} -> {0xc00040cd80 0xc00009c6c0} commontests.go:142: Got 1 recordsets: [0xc000411470] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0004116f0} route53_test.go:93: Got zone list: [0xc000411720] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c788} commontests.go:192: Successfully added resource record set: {0xc00040d050 0xc00009c7a8} commontests.go:142: Got 2 recordsets: [0xc000411990 0xc0004119b0] commontests.go:142: Got 2 recordsets: [0xc000411a20 0xc000411a40] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000411c40} route53_test.go:93: Got zone list: [0xc000411c70] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c8b0} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.016s === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.006s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc000216200} clouddns_test.go:71: Got zone list: [0xc00031e408] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031e3d8} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc000216300} clouddns_test.go:71: Got zone list: [0xc00031e4c8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031e498} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc000216400} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc000820bc0 0xc00031e588} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc0002164c0} clouddns_test.go:71: Got zone list: [0xc00031e648] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031e618} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc0002165e0} clouddns_test.go:71: Got zone list: [0xc00031e780] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031e750} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc000216720} clouddns_test.go:71: Got zone list: [0xc00031e8e8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031e8b8} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc000216880} clouddns_test.go:71: Got zone list: [0xc00031eaf8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031eac8} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc0002169e0} clouddns_test.go:71: Got zone list: [0xc00031ec90] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031ec60} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc000216b20} clouddns_test.go:71: Got zone list: [0xc00031edf8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031edc8} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc000216c80} clouddns_test.go:71: Got zone list: [0xc00031efc0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031ef90} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc000216de0} clouddns_test.go:71: Got zone list: [0xc00031f290] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031f260} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc000216f60} clouddns_test.go:71: Got zone list: [0xc00031f5c0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031f590} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0006a8020 0xc000217140} clouddns_test.go:71: Got zone list: [0xc00031f998] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000820a40 0xc00031f968} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.064s === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.036s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.008s === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.097s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I0518 19:55:32.023134 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.025986 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.026067 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.026130 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.026190 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.026272 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.026348 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.026382 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.026434 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.026480 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.040962 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.02s) === RUN TestContainerdBuilder_Docker_19_03_14 I0518 19:55:32.047989 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.048122 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.048168 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.048214 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.048307 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.048374 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.048416 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.048446 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.048486 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.048515 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.050222 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.01s) === RUN TestContainerdBuilder_Simple I0518 19:55:32.056247 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.056375 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.056420 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.056464 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.056504 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.056558 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.056603 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.056634 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.056680 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.056711 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.071502 56056 zones.go:93] ListHostedZonesPages { } I0518 19:55:32.074257 56056 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I0518 19:55:32.074282 56056 assetstore.go:111] bin/containerd I0518 19:55:32.074296 56056 assetstore.go:111] bin/containerd-shim I0518 19:55:32.074307 56056 assetstore.go:111] bin/containerd-shim-runc-v1 I0518 19:55:32.074318 56056 assetstore.go:111] bin/containerd-shim-runc-v2 I0518 19:55:32.074328 56056 assetstore.go:111] bin/containerd-stress I0518 19:55:32.074339 56056 assetstore.go:111] bin/ctr I0518 19:55:32.074437 56056 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I0518 19:55:32.074456 56056 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.02s) === RUN TestContainerdBuilder_Flatcar I0518 19:55:32.079159 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.079257 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.079292 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.079338 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.079374 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.079420 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.079454 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.079483 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.079522 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.079548 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.080665 56056 zones.go:93] ListHostedZonesPages { } I0518 19:55:32.082932 56056 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.01s) === RUN TestContainerdBuilder_SkipInstall I0518 19:55:32.084414 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.084518 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.084567 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.084615 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.084650 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.084691 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.084731 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.084760 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.084794 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.084819 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.086386 56056 zones.go:93] ListHostedZonesPages { } I0518 19:55:32.094407 56056 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.01s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I0518 19:55:32.097133 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.097270 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.097315 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.097395 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.097452 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.097511 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.097587 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.097623 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.097676 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.097740 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.100360 56056 zones.go:93] ListHostedZonesPages { } I0518 19:55:32.107798 56056 assetstore.go:108] Matching assets for "^docker/": I0518 19:55:32.107828 56056 assetstore.go:111] docker/containerd I0518 19:55:32.107839 56056 assetstore.go:111] docker/containerd-shim I0518 19:55:32.107848 56056 assetstore.go:111] docker/ctr I0518 19:55:32.107857 56056 assetstore.go:111] docker/docker I0518 19:55:32.107865 56056 assetstore.go:111] docker/docker-init I0518 19:55:32.107873 56056 assetstore.go:111] docker/docker-proxy I0518 19:55:32.107881 56056 assetstore.go:111] docker/dockerd I0518 19:55:32.107889 56056 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.02s) === RUN TestDockerBuilder_LogFlags I0518 19:55:32.112613 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.112746 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.112782 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.112822 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.112857 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.112901 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.112939 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.112966 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.113002 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.113028 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.114657 56056 zones.go:93] ListHostedZonesPages { } I0518 19:55:32.117140 56056 assetstore.go:108] Matching assets for "^docker/": I0518 19:55:32.117164 56056 assetstore.go:111] docker/containerd I0518 19:55:32.117176 56056 assetstore.go:111] docker/containerd-shim I0518 19:55:32.117187 56056 assetstore.go:111] docker/ctr I0518 19:55:32.117197 56056 assetstore.go:111] docker/docker I0518 19:55:32.117220 56056 assetstore.go:111] docker/docker-init I0518 19:55:32.117233 56056 assetstore.go:111] docker/docker-proxy I0518 19:55:32.117241 56056 assetstore.go:111] docker/dockerd I0518 19:55:32.117250 56056 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.02s) === RUN TestDockerBuilder_SkipInstall I0518 19:55:32.128407 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.128527 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.128561 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.128605 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.128640 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.128684 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.128723 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.128751 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.128787 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.128812 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.130382 56056 zones.go:93] ListHostedZonesPages { } I0518 19:55:32.132701 56056 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I0518 19:55:32.132920 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.133033 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.133072 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.133120 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.133159 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.133205 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.133241 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.133272 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.133314 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.133340 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.134427 56056 zones.go:93] ListHostedZonesPages { } I0518 19:55:32.135994 56056 assetstore.go:108] Matching assets for "^docker/": I0518 19:55:32.136016 56056 assetstore.go:111] docker/docker I0518 19:55:32.136028 56056 assetstore.go:111] docker/docker-containerd I0518 19:55:32.136038 56056 assetstore.go:111] docker/docker-containerd-ctr I0518 19:55:32.136047 56056 assetstore.go:111] docker/docker-containerd-shim I0518 19:55:32.136056 56056 assetstore.go:111] docker/docker-init I0518 19:55:32.136065 56056 assetstore.go:111] docker/docker-proxy I0518 19:55:32.136074 56056 assetstore.go:111] docker/docker-runc I0518 19:55:32.136083 56056 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.01s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I0518 19:55:32.140240 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.140359 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.140398 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.140445 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.140478 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.140529 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.140566 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.140598 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.140638 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.140665 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.143388 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.01s) === RUN TestDockerHooksBuilder I0518 19:55:32.146982 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.147108 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.147148 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.147195 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.147236 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.147286 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.147340 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.147374 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.147419 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.147450 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.150605 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.01s) === RUN TestKopsControllerBuilder I0518 19:55:32.154746 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.154873 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.154917 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.154965 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.155021 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.155073 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.155120 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.155154 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.155196 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.155229 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.158935 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.01s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I0518 19:55:32.169105 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.169247 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.169293 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.169343 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.169393 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.169444 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.169489 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.169521 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.169563 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.169594 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.172799 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.02s) === RUN TestAuditConfigAPIServerBuilder I0518 19:55:32.190726 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.190859 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.190956 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.191014 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.191065 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.191117 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.191162 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.191193 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.191233 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.191263 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.194776 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I0518 19:55:32.203416 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.203536 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.203579 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.203632 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.203670 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.203719 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.203760 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.203789 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.203829 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.203860 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.206746 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.02s) === RUN TestDeddicatedAPIServerBuilder I0518 19:55:32.221051 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.221194 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.221237 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.221287 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.221329 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.221376 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.221420 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.221448 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.221484 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.221512 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.224244 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I0518 19:55:32.234749 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.234911 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.234995 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.235082 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.235150 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.235230 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.235299 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.235358 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.235423 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.235477 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.237979 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I0518 19:55:32.246272 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.246407 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.246451 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.246489 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.246516 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.246550 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.246578 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.246595 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.246619 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.246638 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.249092 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I0518 19:55:32.259739 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:32.259829 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:32.259859 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:32.259889 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:32.259916 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:32.259949 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:32.259980 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:32.259997 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:32.260019 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:32.260037 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:32.261787 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.97s) === RUN TestKubeAPIServerBuilderARM64 I0518 19:55:34.228755 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:34.228923 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:34.229006 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:34.229095 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:34.229173 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:34.229268 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:34.229357 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:34.229430 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:34.229510 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:34.229573 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:34.232470 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.26s) === RUN TestKubeControllerManagerBuilder I0518 19:55:35.489815 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:35.490011 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:35.490097 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:35.490182 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:35.490251 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:35.490333 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:35.490411 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:35.490471 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:35.490551 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:35.490615 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:35.493427 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I0518 19:55:35.503591 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:35.503719 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:35.503763 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:35.503812 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:35.503852 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:35.503901 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:35.503945 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:35.503976 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:35.504015 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:35.504044 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:35.506806 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.24s) === RUN TestKubeControllerManagerBuilderARM64 I0518 19:55:36.746563 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:36.746656 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:36.746687 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:36.746720 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:36.746746 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:36.746777 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:36.746808 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:36.746826 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:36.746849 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:36.746867 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:36.748602 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.23s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I0518 19:55:37.976671 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:37.976793 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:37.976828 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:37.976870 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:37.976904 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:37.976949 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:37.976987 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:37.977014 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:37.977049 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:37.977074 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:37.979718 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I0518 19:55:37.985894 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:37.986068 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:37.986137 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:37.986205 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:37.986267 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:37.986340 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:37.986405 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:37.986462 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:37.986524 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:37.986576 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:37.989174 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.23s) === RUN TestKubeProxyBuilderARM64 I0518 19:55:39.214345 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:39.214498 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:39.214544 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:39.214594 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:39.214637 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:39.214694 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:39.214740 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:39.214773 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:39.214819 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:39.214852 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:39.217803 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.24s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I0518 19:55:40.454793 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:40.454884 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:40.454913 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:40.454941 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:40.454967 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:40.454998 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:40.455022 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:40.455038 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:40.455064 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:40.455080 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:40.456661 56056 zones.go:93] ListHostedZonesPages { } W0518 19:55:40.459083 56056 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I0518 19:55:40.460693 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:40.460763 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:40.460788 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:40.460812 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:40.460836 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:40.460863 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:40.460886 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:40.460905 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:40.460927 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:40.460944 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:40.462437 56056 zones.go:93] ListHostedZonesPages { } W0518 19:55:41.724212 56056 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.27s) === RUN TestKubeSchedulerBuilderARM64 I0518 19:55:41.727126 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:41.727258 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:41.727305 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:41.727359 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:41.727406 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:41.727461 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:41.727506 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:41.727541 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:41.727581 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:41.727613 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:41.730482 56056 zones.go:93] ListHostedZonesPages { } W0518 19:55:42.947224 56056 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.22s) === RUN TestKubectlBuilder I0518 19:55:42.948927 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:42.949012 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:42.949041 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:42.949070 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:42.949094 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:42.949126 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:42.949153 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:42.949170 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:42.949196 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:42.949214 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:42.950923 56056 zones.go:93] ListHostedZonesPages { } I0518 19:55:42.952882 56056 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I0518 19:55:42.954889 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:42.954958 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:42.955002 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:42.955034 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:42.955062 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:42.955091 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:42.955115 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:42.955132 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:42.955152 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:42.955171 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:42.956540 56056 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I0518 19:55:42.965449 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:42.965550 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:42.965610 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:42.965651 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:42.965692 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:42.965741 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:42.965781 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:42.965817 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:42.965858 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:42.965891 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:42.967917 56056 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.02s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I0518 19:55:42.999326 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:42.999489 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:42.999548 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:42.999603 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:42.999655 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:42.999714 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:42.999769 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:42.999807 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:42.999858 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:42.999890 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:43.012995 56056 zones.go:93] ListHostedZonesPages { } I0518 19:55:43.015634 56056 assetstore.go:108] Matching assets for "protokube$": I0518 19:55:43.015663 56056 assetstore.go:111] /opt/kops/bin/protokube I0518 19:55:43.015678 56056 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I0518 19:55:43.015710 56056 assetstore.go:108] Matching assets for "channels$": I0518 19:55:43.015723 56056 assetstore.go:111] /opt/kops/bin/channels I0518 19:55:43.015734 56056 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.02s) === RUN TestSecretBuilder I0518 19:55:43.017994 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:43.018101 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:43.018133 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:43.018174 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:43.018210 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:43.018256 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:43.018290 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:43.018317 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:43.018352 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:43.018376 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:43.020670 56056 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I0518 19:55:43.023869 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:43.024005 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:43.024066 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:43.024127 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:43.024190 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:43.024260 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:43.024323 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:43.024392 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:43.024456 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:43.024506 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:43.026775 56056 zones.go:93] ListHostedZonesPages { } I0518 19:55:43.029418 56056 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.01s) === RUN TestUpdateServiceBuilderExternal I0518 19:55:43.030115 56056 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:55:43.030261 56056 internetgateways.go:66] CreateInternetGateway: { } I0518 19:55:43.030329 56056 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:55:43.030400 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:55:43.030465 56056 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:55:43.030537 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:55:43.030601 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:55:43.030661 56056 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:55:43.030727 56056 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:55:43.030779 56056 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:55:43.033161 56056 zones.go:93] ListHostedZonesPages { } I0518 19:55:43.035745 56056 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.01s) PASS ok k8s.io/kops/nodeup/pkg/model 11.111s === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.042s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.027s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.026s === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E0518 19:55:31.940831 56060 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E0518 19:55:31.940968 56060 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.008s === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I0518 19:55:32.004567 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.004677 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.004733 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.004775 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.004816 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I0518 19:55:32.005100 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005148 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005180 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005214 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005255 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005290 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005330 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005368 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005406 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005442 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005480 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005520 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005559 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005590 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005621 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005668 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005728 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005764 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0518 19:55:32.005793 56061 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I0518 19:55:32.005991 56061 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I0518 19:55:32.006072 56061 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.092s === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.01s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.014s === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W0518 19:55:31.976434 56063 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W0518 19:55:31.977747 56063 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W0518 19:55:31.978927 56063 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W0518 19:55:31.994608 56063 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.02s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W0518 19:55:31.996094 56063 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W0518 19:55:31.997303 56063 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host W0518 19:55:31.998223 56063 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E0518 19:55:31.999094 56063 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E0518 19:55:31.999110 56063 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E0518 19:55:31.999121 56063 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E0518 19:55:31.999133 56063 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.067s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.004s === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.087s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.047s === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.01s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.154s === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.164s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.023s === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.004s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.004s === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.02s) --- PASS: TestHasExtraFields/minimal (0.02s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.056s === RUN TestFlagToFalse I0518 19:55:41.203814 57329 featureflag_test.go:32] Created flag Unittest1 I0518 19:55:41.203883 57329 featureflag.go:164] FeatureFlag "UnitTest1"=false I0518 19:55:41.203897 57329 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I0518 19:55:41.203978 57329 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.004s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.043s === RUN TestRenderInstanceGroupZones W0518 19:55:41.228650 57331 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.029s === RUN TestWarmPoolOnlyRoll I0518 19:55:56.172283 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.172367 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.172396 57841 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I0518 19:55:56.172921 57841 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0518 19:55:56.172962 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.174245 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.174324 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.180134 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.180211 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.180237 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.180257 57841 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0518 19:55:56.182824 57841 instancegroups.go:431] Draining the node: "master-1a.local". I0518 19:55:56.183654 57841 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0518 19:55:56.183787 57841 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0518 19:55:56.183825 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.184987 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.185024 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.190304 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.190356 57841 instancegroups.go:431] Draining the node: "master-1b.local". I0518 19:55:56.190931 57841 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0518 19:55:56.191015 57841 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0518 19:55:56.191069 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.192232 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.192278 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.197492 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.197548 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.197569 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.197584 57841 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0518 19:55:56.198632 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.199402 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.199436 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.200582 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.200619 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.205821 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.205878 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:56.206826 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:56.206861 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.208009 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.208028 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.213247 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.213316 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:56.214550 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:56.214595 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.215760 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.215801 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.221067 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.221111 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.221132 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.221148 57841 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0518 19:55:56.221885 57841 instancegroups.go:431] Draining the node: "node-2a.local". I0518 19:55:56.222542 57841 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0518 19:55:56.222573 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.223721 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.223746 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.228975 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.229049 57841 instancegroups.go:431] Draining the node: "node-2b.local". I0518 19:55:56.229999 57841 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0518 19:55:56.230034 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.231169 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.231197 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.236455 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.236540 57841 instancegroups.go:431] Draining the node: "node-2c.local". I0518 19:55:56.237456 57841 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0518 19:55:56.237491 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.238625 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.238653 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.243876 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.243934 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I0518 19:55:56.244496 57841 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0518 19:55:56.244525 57841 instancegroups.go:469] waiting for 1ms after terminating instance W0518 19:55:56.245686 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0518 19:55:56.245729 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0518 19:55:56.245761 57841 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0518 19:55:56.245772 57841 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0518 19:55:56.245788 57841 instancegroups.go:469] waiting for 1ms after terminating instance W0518 19:55:56.246905 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0518 19:55:56.246946 57841 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0518 19:55:56.246962 57841 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0518 19:55:56.246987 57841 instancegroups.go:469] waiting for 1ms after terminating instance W0518 19:55:56.248124 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0518 19:55:56.248145 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0518 19:55:56.248178 57841 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0518 19:55:56.248191 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.248207 57841 instancegroups.go:469] waiting for 1ms after terminating instance W0518 19:55:56.249332 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0518 19:55:56.249379 57841 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0518 19:55:56.249398 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:56.249423 57841 instancegroups.go:469] waiting for 1ms after terminating instance W0518 19:55:56.250580 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0518 19:55:56.250620 57841 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0518 19:55:56.250633 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:56.250650 57841 instancegroups.go:469] waiting for 1ms after terminating instance W0518 19:55:56.251766 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0518 19:55:56.251796 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0518 19:55:56.251836 57841 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0518 19:55:56.251856 57841 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0518 19:55:56.251881 57841 instancegroups.go:469] waiting for 1ms after terminating instance W0518 19:55:56.253005 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0518 19:55:56.253054 57841 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0518 19:55:56.253069 57841 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0518 19:55:56.253092 57841 instancegroups.go:469] waiting for 1ms after terminating instance W0518 19:55:56.254210 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0518 19:55:56.254248 57841 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0518 19:55:56.254264 57841 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0518 19:55:56.254288 57841 instancegroups.go:469] waiting for 1ms after terminating instance W0518 19:55:56.255469 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0518 19:55:56.255505 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I0518 19:55:56.255812 57841 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0518 19:55:56.255837 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.256966 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.256997 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.257017 57841 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.257059 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.257079 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.257093 57841 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.257107 57841 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0518 19:55:56.257879 57841 instancegroups.go:431] Draining the node: "master-1a.local". I0518 19:55:56.258603 57841 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0518 19:55:56.258682 57841 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0518 19:55:56.258711 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.259850 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.259874 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.259892 57841 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.259923 57841 instancegroups.go:431] Draining the node: "master-1b.local". I0518 19:55:56.260584 57841 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0518 19:55:56.260630 57841 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0518 19:55:56.260654 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.261772 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.261801 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.261821 57841 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.261845 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.261866 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.261885 57841 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.261899 57841 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0518 19:55:56.262890 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.263669 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.263703 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.264810 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.264834 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.264848 57841 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.264874 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:56.265373 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:56.265393 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.266826 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.266856 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.266879 57841 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.266925 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:56.267867 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:56.267899 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.269226 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.269250 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.269270 57841 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.269287 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.269304 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.269323 57841 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.269343 57841 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0518 19:55:56.270396 57841 instancegroups.go:431] Draining the node: "node-2a.local". I0518 19:55:56.271219 57841 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0518 19:55:56.271255 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.272384 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.272431 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.272453 57841 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.272491 57841 instancegroups.go:431] Draining the node: "node-2b.local". I0518 19:55:56.273495 57841 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0518 19:55:56.273544 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.274691 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.274740 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.274763 57841 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.274803 57841 instancegroups.go:431] Draining the node: "node-2c.local". I0518 19:55:56.275377 57841 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0518 19:55:56.275407 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.276544 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.276575 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0518 19:55:56.276609 57841 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0518 19:55:56.276634 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I0518 19:55:56.277020 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I0518 19:55:56.277374 57841 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0518 19:55:56.277406 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.278555 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.278582 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.283794 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.283876 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.283892 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.283902 57841 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0518 19:55:56.284562 57841 instancegroups.go:431] Draining the node: "master-1a.local". I0518 19:55:56.285078 57841 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0518 19:55:56.285148 57841 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0518 19:55:56.285171 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.286337 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.286376 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.291623 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.291718 57841 instancegroups.go:431] Draining the node: "master-1b.local". I0518 19:55:56.292902 57841 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0518 19:55:56.292989 57841 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0518 19:55:56.293042 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.294205 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.294240 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.299541 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.299588 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.299602 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.299612 57841 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0518 19:55:56.300282 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.300781 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.300806 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.301983 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.302006 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.307250 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.307299 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:56.307931 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:56.307956 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.309096 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.309126 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.314337 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.314409 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:56.315032 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:56.315057 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.316194 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.316232 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.321424 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.321462 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.321476 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.321488 57841 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0518 19:55:56.322224 57841 instancegroups.go:431] Draining the node: "node-2a.local". I0518 19:55:56.322736 57841 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0518 19:55:56.322763 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.323922 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.323945 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.329147 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.329214 57841 instancegroups.go:431] Draining the node: "node-2b.local". I0518 19:55:56.329875 57841 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0518 19:55:56.329908 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.331064 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.331090 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.336313 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.336370 57841 instancegroups.go:431] Draining the node: "node-2c.local". I0518 19:55:56.337003 57841 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0518 19:55:56.337036 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.338163 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.338184 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.343381 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.343423 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.07s) === RUN TestRollingUpdateEmptyGroup I0518 19:55:56.343592 57841 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I0518 19:55:56.343995 57841 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0518 19:55:56.344029 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.347764 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.347812 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0518 19:55:56.347831 57841 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I0518 19:55:56.348123 57841 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0518 19:55:56.348148 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.354417 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.354453 57841 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0518 19:55:56.354476 57841 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.01s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I0518 19:55:56.354724 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.354744 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0518 19:55:56.354759 57841 instancegroups.go:509] Cluster did not validate within 0s E0518 19:55:56.354773 57841 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I0518 19:55:56.354919 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.354936 57841 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0518 19:55:56.354951 57841 instancegroups.go:509] Cluster did not validate within 0s E0518 19:55:56.354964 57841 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I0518 19:55:56.355156 57841 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0518 19:55:56.355181 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.364715 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.364768 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.374440 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.374519 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.374542 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.374557 57841 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0518 19:55:56.375286 57841 instancegroups.go:431] Draining the node: "master-1a.local". I0518 19:55:56.376571 57841 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0518 19:55:56.376635 57841 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0518 19:55:56.376661 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.381090 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.381144 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0518 19:55:56.381167 57841 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.03s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I0518 19:55:56.381462 57841 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0518 19:55:56.381486 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.384154 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.384194 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.389429 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.389503 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.389527 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.389540 57841 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0518 19:55:56.390126 57841 instancegroups.go:431] Draining the node: "master-1a.local". I0518 19:55:56.390598 57841 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0518 19:55:56.390659 57841 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0518 19:55:56.390683 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.391813 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.391843 57841 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0518 19:55:56.391861 57841 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I0518 19:55:56.392142 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.392164 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.392177 57841 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0518 19:55:56.392759 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.393217 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.393246 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.394375 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.394397 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.399622 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.399704 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:56.400676 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:56.400715 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.401858 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.401888 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.407098 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.407159 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:56.407985 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:56.408015 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.409152 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.409202 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.414410 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.414450 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I0518 19:55:56.414719 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.414739 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0518 19:55:56.414753 57841 instancegroups.go:509] Cluster did not validate within 0s E0518 19:55:56.414771 57841 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I0518 19:55:56.414937 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.414953 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0518 19:55:56.414963 57841 instancegroups.go:509] Cluster did not validate within 0s E0518 19:55:56.414972 57841 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I0518 19:55:56.415123 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.415139 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0518 19:55:56.415149 57841 instancegroups.go:509] Cluster did not validate within 0s E0518 19:55:56.415157 57841 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I0518 19:55:56.415341 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.415356 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.415365 57841 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0518 19:55:56.416084 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.416599 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.416628 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.417781 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.417862 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.423106 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.423184 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:56.424150 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:56.424192 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.425325 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.425352 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.430572 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.430638 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:56.431581 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:56.431617 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.432743 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.432769 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.437982 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.438017 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.438043 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0518 19:55:56.438066 57841 instancegroups.go:509] Cluster did not validate within 0s E0518 19:55:56.438086 57841 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I0518 19:55:56.438380 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.438406 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.438419 57841 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0518 19:55:56.439440 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.440165 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.440199 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.441317 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.441352 57841 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0518 19:55:56.441373 57841 instancegroups.go:509] Cluster did not validate within 0s E0518 19:55:56.441392 57841 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I0518 19:55:56.441595 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.441621 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.441637 57841 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0518 19:55:56.442548 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.443272 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.443302 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.444388 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.444418 57841 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0518 19:55:56.444440 57841 instancegroups.go:509] Cluster did not validate within 0s E0518 19:55:56.444457 57841 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I0518 19:55:56.444717 57841 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0518 19:55:56.444743 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.445860 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.445905 57841 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0518 19:55:56.447026 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.452249 57841 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0518 19:55:56.453396 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.458632 57841 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0518 19:55:56.459780 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.465011 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.465106 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.465138 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.465158 57841 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0518 19:55:56.465998 57841 instancegroups.go:431] Draining the node: "master-1a.local". I0518 19:55:56.466758 57841 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0518 19:55:56.466837 57841 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0518 19:55:56.466867 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.467999 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.468028 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.473219 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.473284 57841 instancegroups.go:431] Draining the node: "master-1b.local". I0518 19:55:56.474091 57841 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0518 19:55:56.474162 57841 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0518 19:55:56.474191 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.475325 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.475379 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.480653 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.480698 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.480717 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.480728 57841 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0518 19:55:56.481400 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.481857 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.481880 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.482996 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.483029 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.488272 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.488322 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:56.488938 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:56.488962 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.490077 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.490109 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.495377 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.495439 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:56.496280 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:56.496310 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.497419 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.497462 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.502718 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.502773 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.502802 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.502818 57841 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0518 19:55:56.503814 57841 instancegroups.go:431] Draining the node: "node-2a.local". I0518 19:55:56.504529 57841 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0518 19:55:56.504568 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.505707 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.505741 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.510939 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.510988 57841 instancegroups.go:431] Draining the node: "node-2b.local". I0518 19:55:56.511568 57841 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0518 19:55:56.511594 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.512749 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.512801 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.518027 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.518078 57841 instancegroups.go:431] Draining the node: "node-2c.local". I0518 19:55:56.518692 57841 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0518 19:55:56.518715 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.519827 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.519857 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.525062 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.525093 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I0518 19:55:56.525321 57841 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0518 19:55:56.525342 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.526486 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.526510 57841 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0518 19:55:56.527638 57841 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0518 19:55:56.528782 57841 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0518 19:55:56.529889 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.535081 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.535139 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.535154 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.535165 57841 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0518 19:55:56.535695 57841 instancegroups.go:431] Draining the node: "master-1a.local". I0518 19:55:56.536686 57841 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0518 19:55:56.536744 57841 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0518 19:55:56.536766 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.537905 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.537928 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.543124 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.543167 57841 instancegroups.go:431] Draining the node: "master-1b.local". I0518 19:55:56.543676 57841 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0518 19:55:56.543724 57841 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0518 19:55:56.543743 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.544856 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.544883 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.550111 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.550144 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.550161 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.550178 57841 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0518 19:55:56.551056 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.551711 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.551739 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.554402 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.554428 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.561059 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.561105 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:56.561906 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:56.561935 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.567721 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.567747 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.574405 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.574458 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:56.575290 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:56.575317 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.581061 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.581085 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.587719 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.587744 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.587764 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.587778 57841 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0518 19:55:56.588601 57841 instancegroups.go:431] Draining the node: "node-2a.local". I0518 19:55:56.589263 57841 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0518 19:55:56.589291 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.594385 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.594410 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.599583 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.599626 57841 instancegroups.go:431] Draining the node: "node-2b.local". I0518 19:55:56.602157 57841 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0518 19:55:56.602203 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.603368 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.603411 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.608619 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.608699 57841 instancegroups.go:431] Draining the node: "node-2c.local". I0518 19:55:56.609654 57841 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0518 19:55:56.609690 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.610857 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.610904 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.616067 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.616123 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.09s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I0518 19:55:56.616849 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.616875 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.616890 57841 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0518 19:55:56.617673 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.618506 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.618538 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.619708 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.619731 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.624941 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.625000 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:56.625608 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:56.625634 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.626797 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.626827 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.632051 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.632089 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.02s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I0518 19:55:56.632344 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.632363 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.632372 57841 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0518 19:55:56.632868 57841 instancegroups.go:431] Draining the node: "master-1a.local". I0518 19:55:56.633321 57841 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0518 19:55:56.633373 57841 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0518 19:55:56.633393 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.634522 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.634549 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.639755 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.639813 57841 instancegroups.go:431] Draining the node: "master-1b.local". I0518 19:55:56.640392 57841 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0518 19:55:56.640447 57841 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0518 19:55:56.640469 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.641814 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.641841 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.647056 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.647102 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I0518 19:55:56.647429 57841 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W0518 19:55:56.647455 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0518 19:55:56.647468 57841 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W0518 19:55:56.647481 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0518 19:55:56.647491 57841 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W0518 19:55:56.647499 57841 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0518 19:55:56.647509 57841 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0518 19:55:56.647520 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I0518 19:55:56.647671 57841 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I0518 19:55:56.647719 57841 instancegroups.go:203] waiting for 1ms after detaching instance I0518 19:55:56.648856 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.648881 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.654108 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.654152 57841 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I0518 19:55:56.654218 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.654244 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.654260 57841 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0518 19:55:56.655023 57841 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I0518 19:55:56.655042 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.655053 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.655060 57841 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0518 19:55:56.655555 57841 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0518 19:55:56.655603 57841 instancegroups.go:203] waiting for 1ms after detaching instance I0518 19:55:56.656731 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.656757 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.661979 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.662037 57841 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I0518 19:55:56.662057 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.662076 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.662090 57841 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0518 19:55:56.663054 57841 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I0518 19:55:56.663111 57841 instancegroups.go:203] waiting for 1ms after detaching instance I0518 19:55:56.664257 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.664288 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:56.669517 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.669564 57841 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0518 19:55:56.669584 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I0518 19:55:56.669840 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.669864 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.669874 57841 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0518 19:55:56.671382 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.671925 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.671970 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.673126 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.673167 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.673212 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:56.673334 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:56.674287 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:56.674522 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:56.674560 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.675723 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.675762 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.776231 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.776306 57841 instancegroups.go:431] Draining the node: "node-1e.local". I0518 19:55:56.777186 57841 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0518 19:55:56.777235 57841 instancegroups.go:431] Draining the node: "node-1d.local". I0518 19:55:56.781281 57841 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0518 19:55:56.781327 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.782466 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.782497 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.782524 57841 instancegroups.go:431] Draining the node: "node-1f.local". I0518 19:55:56.783255 57841 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0518 19:55:56.783290 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.784391 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.784436 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.885319 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.885389 57841 instancegroups.go:431] Draining the node: "node-1g.local". I0518 19:55:56.886012 57841 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0518 19:55:56.886046 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.887201 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.887229 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.887244 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.22s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I0518 19:55:56.887415 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.887434 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.887442 57841 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0518 19:55:56.888493 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:56.888543 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:56.889130 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:56.889277 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:56.889301 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.890428 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.890492 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.991099 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.991178 57841 instancegroups.go:431] Draining the node: "node-1d.local". I0518 19:55:56.992017 57841 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0518 19:55:56.992066 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:56.992706 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:56.992742 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.994402 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.994445 57841 instancegroups.go:540] Cluster validated. I0518 19:55:56.994473 57841 instancegroups.go:431] Draining the node: "node-1e.local". I0518 19:55:56.995227 57841 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0518 19:55:56.995262 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:56.997713 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:56.997766 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.098332 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.098439 57841 instancegroups.go:431] Draining the node: "node-1f.local". I0518 19:55:57.099311 57841 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0518 19:55:57.099365 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.100510 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.100543 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.100562 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I0518 19:55:57.100800 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.100834 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.100849 57841 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I0518 19:55:57.102154 57841 instancegroups.go:431] Draining the node: "master-1a.local". I0518 19:55:57.102560 57841 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0518 19:55:57.102612 57841 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0518 19:55:57.102639 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.103967 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.104027 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.104073 57841 instancegroups.go:431] Draining the node: "master-1c.local". I0518 19:55:57.104087 57841 instancegroups.go:431] Draining the node: "master-1b.local". I0518 19:55:57.104900 57841 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0518 19:55:57.104986 57841 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0518 19:55:57.105477 57841 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I0518 19:55:57.105523 57841 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I0518 19:55:57.105558 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.111164 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.111256 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.211655 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.211731 57841 instancegroups.go:431] Draining the node: "master-1e.local". I0518 19:55:57.212634 57841 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I0518 19:55:57.212727 57841 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I0518 19:55:57.212807 57841 instancegroups.go:431] Draining the node: "master-1d.local". I0518 19:55:57.213577 57841 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I0518 19:55:57.213630 57841 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I0518 19:55:57.213668 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.214808 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.214838 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.214864 57841 instancegroups.go:431] Draining the node: "master-1f.local". I0518 19:55:57.215323 57841 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I0518 19:55:57.215361 57841 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I0518 19:55:57.215383 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.216498 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.216548 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.316987 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.317059 57841 instancegroups.go:431] Draining the node: "master-1g.local". I0518 19:55:57.317980 57841 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I0518 19:55:57.318065 57841 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I0518 19:55:57.318110 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.319268 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.319297 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.319311 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.22s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I0518 19:55:57.319496 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.319517 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.319526 57841 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0518 19:55:57.320488 57841 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0518 19:55:57.320529 57841 instancegroups.go:203] waiting for 1ms after detaching instance I0518 19:55:57.321652 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.321689 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.321706 57841 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0518 19:55:57.321757 57841 instancegroups.go:203] waiting for 1ms after detaching instance I0518 19:55:57.322906 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.322931 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.322961 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:57.323014 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:57.323462 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:57.323803 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:57.323829 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.324976 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.325033 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.425385 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.425456 57841 instancegroups.go:431] Draining the node: "node-1d.local". I0518 19:55:57.425473 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:57.426420 57841 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0518 19:55:57.426576 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:57.426604 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.427722 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.427756 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.427788 57841 instancegroups.go:431] Draining the node: "node-1e.local". I0518 19:55:57.428474 57841 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0518 19:55:57.428517 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.429674 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.429725 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.530124 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.530200 57841 instancegroups.go:431] Draining the node: "node-1f.local". I0518 19:55:57.531169 57841 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0518 19:55:57.531225 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.532355 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.532391 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.532412 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I0518 19:55:57.532657 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.532686 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.532699 57841 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0518 19:55:57.534263 57841 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0518 19:55:57.534309 57841 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0518 19:55:57.534365 57841 instancegroups.go:203] waiting for 1ms after detaching instance I0518 19:55:57.535493 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.535520 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.535548 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:57.535574 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:57.536384 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:57.536542 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:57.536569 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.537679 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.537740 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.638147 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.638218 57841 instancegroups.go:431] Draining the node: "node-1d.local". I0518 19:55:57.638254 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:57.639182 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:57.639402 57841 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0518 19:55:57.639444 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.640604 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.640633 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.640655 57841 instancegroups.go:431] Draining the node: "node-1e.local". I0518 19:55:57.641167 57841 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0518 19:55:57.641200 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.642316 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.642360 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.743051 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.743123 57841 instancegroups.go:431] Draining the node: "node-1f.local". I0518 19:55:57.743975 57841 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0518 19:55:57.744032 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.745175 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.745217 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.745240 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I0518 19:55:57.745476 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.745502 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.745516 57841 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0518 19:55:57.746108 57841 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0518 19:55:57.746141 57841 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I0518 19:55:57.746172 57841 instancegroups.go:203] waiting for 1ms after detaching instance I0518 19:55:57.747283 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.747306 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:57.752522 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.752604 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:57.752635 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:57.753631 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:57.753658 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.753898 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:57.753932 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.754853 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.754877 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:57.764427 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.764477 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.02s) === RUN TestRollingUpdateDetachFails I0518 19:55:57.764740 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.764762 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.764775 57841 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0518 19:55:57.765451 57841 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E0518 19:55:57.765502 57841 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I0518 19:55:57.765516 57841 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E0518 19:55:57.765540 57841 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I0518 19:55:57.765565 57841 instancegroups.go:203] waiting for 1ms after detaching instance I0518 19:55:57.767725 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.767746 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:57.774415 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.774481 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:57.775340 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:57.775371 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.775402 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:57.776049 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:57.776074 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.777734 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.777762 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:57.784419 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.784469 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.02s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I0518 19:55:57.784754 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.784786 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.784800 57841 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I0518 19:55:57.786026 57841 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0518 19:55:57.786077 57841 instancegroups.go:203] waiting for 1ms after detaching instance I0518 19:55:57.787722 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.787766 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.787780 57841 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0518 19:55:57.787837 57841 instancegroups.go:203] waiting for 1ms after detaching instance I0518 19:55:57.791065 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.791096 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.791138 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:57.791940 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:57.791979 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.792015 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:57.792659 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:57.792693 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.792717 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:57.793351 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:57.793384 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.793405 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.893775 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.893838 57841 instancegroups.go:431] Draining the node: "node-1d.local". I0518 19:55:57.894471 57841 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0518 19:55:57.894508 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.895662 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.895713 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.895736 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I0518 19:55:57.896011 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.896040 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.896055 57841 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0518 19:55:57.898184 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:57.898969 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:57.899017 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.900189 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.900230 57841 instancegroups.go:540] Cluster validated. I0518 19:55:57.900261 57841 instancegroups.go:431] Draining the node: "node-1e.local". I0518 19:55:57.900287 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:57.901141 57841 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0518 19:55:57.901288 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:57.901320 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:57.902458 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:57.902529 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:58.003221 57841 instancegroups.go:540] Cluster validated. I0518 19:55:58.003285 57841 instancegroups.go:431] Draining the node: "node-1g.local". I0518 19:55:58.003316 57841 instancegroups.go:431] Draining the node: "node-1f.local". I0518 19:55:58.004186 57841 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0518 19:55:58.004438 57841 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0518 19:55:58.004475 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:58.005626 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:58.005653 57841 instancegroups.go:540] Cluster validated. I0518 19:55:58.005674 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:58.006118 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:58.006143 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:58.007294 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:58.007348 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:58.107883 57841 instancegroups.go:540] Cluster validated. I0518 19:55:58.107949 57841 instancegroups.go:431] Draining the node: "node-1d.local". I0518 19:55:58.108546 57841 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0518 19:55:58.108583 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:58.109750 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:58.109788 57841 instancegroups.go:540] Cluster validated. I0518 19:55:58.109802 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I0518 19:55:58.109980 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:58.109995 57841 instancegroups.go:540] Cluster validated. I0518 19:55:58.110005 57841 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0518 19:55:58.110015 57841 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0518 19:55:58.110024 57841 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0518 19:55:58.110038 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I0518 19:55:58.110130 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:58.110143 57841 instancegroups.go:540] Cluster validated. I0518 19:55:58.110151 57841 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0518 19:55:58.110689 57841 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0518 19:55:58.110704 57841 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0518 19:55:58.110713 57841 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0518 19:55:58.110740 57841 instancegroups.go:431] Draining the node: "node-1a.local". I0518 19:55:58.111171 57841 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0518 19:55:58.111191 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:58.112984 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:58.113002 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:58.119084 57841 instancegroups.go:540] Cluster validated. I0518 19:55:58.119159 57841 instancegroups.go:431] Draining the node: "node-1b.local". I0518 19:55:58.120065 57841 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0518 19:55:58.120102 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:58.121233 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:58.121258 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:58.127729 57841 instancegroups.go:540] Cluster validated. I0518 19:55:58.127772 57841 instancegroups.go:431] Draining the node: "node-1c.local". I0518 19:55:58.128473 57841 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0518 19:55:58.128499 57841 instancegroups.go:469] waiting for 1ms after terminating instance I0518 19:55:58.131067 57841 instancegroups.go:504] Validating the cluster. I0518 19:55:58.131091 57841 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0518 19:55:58.137731 57841 instancegroups.go:540] Cluster validated. I0518 19:55:58.137768 57841 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.03s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 2.080s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.004s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.014s === RUN TestParse E0518 19:55:56.078449 57844 versions.go:96] unable to parse Kubernetes version "" E0518 19:55:56.078547 57844 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.009s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.043s === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.18s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.01s) PASS ok k8s.io/kops/pkg/kubeconfig 0.263s === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.090s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.090s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.103s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I0518 19:55:56.141139 57850 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.077s === RUN Test_RunEtcdManagerBuilder I0518 19:55:56.155967 57851 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W0518 19:55:56.207952 57851 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W0518 19:55:56.211087 57851 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.06s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.02s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.152s === RUN Test_RunKubeApiserverBuilder I0518 19:55:56.154307 57852 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.02s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.02s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.109s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.02s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.02s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.114s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.034s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.089s === RUN TestServerGroupBuilder I0518 19:56:05.152872 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.163934 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.188056 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.214511 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.223340 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.305723 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.324199 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.342316 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.357932 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.372688 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.380712 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.393058 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.420554 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.432497 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.481979 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.488771 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.494727 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.501096 58738 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.36s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.545s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.099s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.081s === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.105s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.01s) --- PASS: TestGenerateCertificate/selfsigned (0.01s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (1.57s) --- PASS: TestIssueCert/ca (0.42s) --- PASS: TestIssueCert/client (0.35s) --- PASS: TestIssueCert/clientOneYear (0.79s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 1.583s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.004s === RUN TestAddUntaggedRouteTables I0518 19:56:05.153623 58746 routetable.go:53] DescribeRouteTables: { } W0518 19:56:05.153750 58746 tags.go:67] cluster tag not found on route-table:rtb-1234 I0518 19:56:05.153769 58746 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I0518 19:56:05.153878 58746 iaminstanceprofile.go:193] ListInstanceProfiles: { } W0518 19:56:05.153948 58746 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I0518 19:56:05.154058 58746 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I0518 19:56:05.154149 58746 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I0518 19:56:05.154218 58746 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I0518 19:56:05.154371 58746 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I0518 19:56:05.154481 58746 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I0518 19:56:05.154534 58746 volumes.go:128] DescribeVolumes: { } W0518 19:56:05.154565 58746 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I0518 19:56:05.154724 58746 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:05.154812 58746 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:05.154850 58746 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:05.154912 58746 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:05.154953 58746 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:05.155018 58746 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:05.155090 58746 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:05.155136 58746 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:05.155176 58746 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:05.155224 58746 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:05.155256 58746 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I0518 19:56:05.155293 58746 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I0518 19:56:05.155322 58746 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I0518 19:56:05.155370 58746 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I0518 19:56:05.155413 58746 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I0518 19:56:05.155456 58746 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I0518 19:56:05.155501 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I0518 19:56:05.155536 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I0518 19:56:05.155564 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I0518 19:56:05.155589 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I0518 19:56:05.155622 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I0518 19:56:05.155648 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I0518 19:56:05.155678 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I0518 19:56:05.155704 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I0518 19:56:05.155732 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I0518 19:56:05.155758 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I0518 19:56:05.155791 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I0518 19:56:05.155832 58746 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.184s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.146s === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.167s === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.006s === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.004s === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.004s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.004s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.004s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.01s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.042s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.093s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.005s === RUN TestRemovesDuplicateGuardedBlocks W0518 19:56:13.258627 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.258703 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.258713 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.258720 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.258727 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.258733 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.258739 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.258745 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.258750 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.258756 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.258761 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.258767 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.258776 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.258786 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.258794 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.258800 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.267265 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.267307 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.267410 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.267426 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.267522 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.267537 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.267632 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.267645 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.267762 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.267777 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.267891 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.267906 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.268004 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.268018 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.268133 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.268147 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.268230 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.268243 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.268329 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.268339 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.268433 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.268481 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.268581 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.268594 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.268674 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.268686 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.268776 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.268787 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.268849 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.268861 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.268926 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.268939 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.268993 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269002 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269071 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269080 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269150 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269159 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269274 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269283 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269353 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269362 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269418 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269427 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269518 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269528 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269596 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269605 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269666 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269675 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269723 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269731 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269783 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269793 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269854 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269863 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269938 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.269947 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.269997 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270004 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270079 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270087 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270145 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270155 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270215 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270228 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270282 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270290 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270363 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270372 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270434 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270443 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270528 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270537 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270616 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270628 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270684 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270692 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270758 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270767 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270862 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270875 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.270943 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.270955 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.271046 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.271057 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.271122 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.271132 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.271189 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.271202 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.271253 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.271278 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.271370 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.271383 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.271478 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.271492 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.271570 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.271583 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.271661 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.271683 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.271756 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.271769 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.271859 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.271872 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.271960 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.271973 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.272054 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.272068 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.272157 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.272171 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.272273 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.272289 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.272368 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.272384 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.272479 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.272495 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.272576 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.272587 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.272650 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.272660 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.272745 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.272755 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.272803 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.272812 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.272892 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.272902 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.272962 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.272971 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273026 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273035 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273086 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273095 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273150 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273160 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273211 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273220 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273282 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273292 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273339 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273348 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273400 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273409 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273461 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273471 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273525 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273534 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273588 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273597 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273645 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273666 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273729 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273739 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273790 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273802 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273870 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273882 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.273962 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.273975 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.274086 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.274100 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.274173 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.274186 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.274252 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.274264 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.274334 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.274347 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.274460 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.274473 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.274544 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.274556 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.274619 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.274631 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.274698 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.274710 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.274778 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.274790 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.274855 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.274908 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.275030 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.275083 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.275173 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.275183 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.275239 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.275254 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.275337 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.275353 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.275464 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.275480 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.275574 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.275590 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.275690 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.275706 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.275790 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.275805 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.275888 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.275903 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.275976 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.275989 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.02s) === RUN TestRecoversFromBadNesting W0518 19:56:13.276442 59965 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0518 19:56:13.276458 59965 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0518 19:56:13.276469 59965 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0518 19:56:13.276480 59965 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0518 19:56:13.276489 59965 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0518 19:56:13.276496 59965 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0518 19:56:13.276503 59965 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0518 19:56:13.276545 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.276562 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.276572 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.276583 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.276593 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.276602 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.276611 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.276620 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.276629 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.276638 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.276650 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.276659 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.276668 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.276678 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.276687 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.276698 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.290537 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.290572 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.290660 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.290678 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.290756 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.290773 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.290863 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.290881 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.291030 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.291051 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.291141 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.291159 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.291238 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.291255 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.291334 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.291351 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.291425 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.291443 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.291517 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.291534 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.291625 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.291644 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.291724 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.291741 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.291827 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.291854 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.291954 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.291971 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.292061 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.292080 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.292171 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.292189 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.292263 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.292281 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.292355 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.292371 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.292475 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.292493 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.292588 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.292606 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.292679 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.292695 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.292780 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.292798 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.292870 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.292886 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.292963 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.292978 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.293050 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.293066 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.293166 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.293183 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.293255 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.293271 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.293348 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.293364 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.293478 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.293497 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.293571 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.293587 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.293670 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.293687 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.293771 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.293788 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.293862 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.293878 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.293949 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.293965 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.294037 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.294053 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.294140 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.294158 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.294258 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.294275 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.294348 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.294377 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.294459 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.294476 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.294552 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.294569 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.294648 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.294665 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.294752 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.294769 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.294840 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.294857 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.294950 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.294967 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.295097 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.295184 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.295328 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.295347 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.295425 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.295443 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.295518 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.295536 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.295608 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.295624 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.295702 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.295718 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.295790 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.295807 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.295884 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.295901 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.296003 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.296021 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.296101 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.296114 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.296185 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.296200 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.296283 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.296298 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.296371 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.296385 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.296481 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.296497 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.296571 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.296588 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.296659 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.296671 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.296741 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.296758 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.296839 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.296856 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.296938 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.296965 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.297041 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.297060 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.297153 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.297170 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.297246 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.297273 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.297354 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.297371 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.297444 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.297460 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.297532 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.297548 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.297628 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.297658 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.297759 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.297777 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.297851 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.297869 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.297940 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.297956 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.298033 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.298049 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.298120 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.298138 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.298212 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.298228 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.298352 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.298370 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.298451 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.298469 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.298543 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.298559 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.298632 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.298649 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.298730 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.298759 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.298840 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.298857 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.298941 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.298958 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.299041 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.299058 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.299132 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.299149 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.299231 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.299248 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.299322 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.299349 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.299448 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.299465 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.299538 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.299554 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.299634 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.299652 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.299742 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.299760 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.299835 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.299852 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.299924 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.299942 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.300023 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.300040 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.300117 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.300134 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.300237 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.300254 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.300371 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.300385 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.300478 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.300491 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0518 19:56:13.300573 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0518 19:56:13.300598 59965 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.02s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.047s === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.01s) PASS ok k8s.io/kops/tests/codecs 0.040s === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.01s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.070s === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.02s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.02s) PASS ok k8s.io/kops/tests/integration/conversion 0.060s === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I0518 19:56:13.296754 59974 files.go:57] Writing file "/tmp/TestWriteFile1360609651/001/SubDir/test1.tmp" I0518 19:56:13.296845 59974 files.go:113] Changing file mode for "/tmp/TestWriteFile1360609651/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.01s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.053s === RUN TestBootstrapChannelBuilder_BuildTasks I0518 19:56:18.302957 60808 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:18.303201 60808 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:18.303261 60808 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:18.303323 60808 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:18.303369 60808 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:18.303452 60808 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:18.303507 60808 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:18.303538 60808 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:18.303590 60808 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:18.303647 60808 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:18.314779 60808 zones.go:93] ListHostedZonesPages { } I0518 19:56:18.507137 60808 zones.go:93] ListHostedZonesPages { } I0518 19:56:18.690990 60808 zones.go:93] ListHostedZonesPages { } I0518 19:56:18.830619 60808 zones.go:93] ListHostedZonesPages { } I0518 19:56:18.970381 60808 zones.go:93] ListHostedZonesPages { } I0518 19:56:19.118867 60808 zones.go:93] ListHostedZonesPages { } I0518 19:56:19.257881 60808 zones.go:93] ListHostedZonesPages { } I0518 19:56:19.474064 60808 zones.go:93] ListHostedZonesPages { } I0518 19:56:20.050059 60808 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.86s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I0518 19:56:20.162447 60808 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:20.162556 60808 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:20.162617 60808 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:20.162659 60808 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:20.162691 60808 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:20.162723 60808 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:20.162759 60808 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:20.162783 60808 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:20.162810 60808 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:20.162827 60808 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:20.162849 60808 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I0518 19:56:20.163970 60808 zones.go:93] ListHostedZonesPages { } I0518 19:56:20.327393 60808 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.17s) === RUN TestBootstrapChannelBuilder_AWSCloudController I0518 19:56:20.327546 60808 featureflag.go:164] FeatureFlag "ImageDigest"=false I0518 19:56:20.327628 60808 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:20.327691 60808 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0518 19:56:20.327740 60808 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0518 19:56:20.327779 60808 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0518 19:56:20.327828 60808 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0518 19:56:20.327865 60808 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0518 19:56:20.327896 60808 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0518 19:56:20.327956 60808 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0518 19:56:20.327985 60808 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0518 19:56:20.329087 60808 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.18s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.08s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W0518 19:56:20.611310 60808 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.01s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I0518 19:56:20.669698 60808 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I0518 19:56:20.669771 60808 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I0518 19:56:20.669784 60808 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I0518 19:56:20.669840 60808 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I0518 19:56:20.669853 60808 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I0518 19:56:20.669905 60808 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I0518 19:56:20.669959 60808 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I0518 19:56:20.670020 60808 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0518 19:56:20.670035 60808 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I0518 19:56:20.670089 60808 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0518 19:56:20.670103 60808 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I0518 19:56:20.670192 60808 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I0518 19:56:20.670280 60808 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I0518 19:56:20.670336 60808 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I0518 19:56:20.670348 60808 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I0518 19:56:20.670357 60808 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I0518 19:56:20.670370 60808 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I0518 19:56:20.670381 60808 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I0518 19:56:20.670391 60808 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I0518 19:56:20.670402 60808 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I0518 19:56:20.670408 60808 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I0518 19:56:20.671545 60808 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I0518 19:56:20.671739 60808 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.466s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I0518 19:56:18.291581 60809 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3410054818/001 I0518 19:56:18.292037 60809 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3410054818/001 I0518 19:56:18.292377 60809 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3410054818/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.01s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I0518 19:56:18.302747 60809 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0518 19:56:18.302891 60809 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0518 19:56:18.302955 60809 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I0518 19:56:18.303181 60809 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0518 19:56:18.303408 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.303505 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.303539 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.303861 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:56:18.303917 60809 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0518 19:56:18.303978 60809 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0518 19:56:18.304085 60809 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0518 19:56:18.304223 60809 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0518 19:56:18.304313 60809 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0518 19:56:18.304431 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.304501 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.304530 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.304592 60809 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0518 19:56:18.304676 60809 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0518 19:56:18.304771 60809 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I0518 19:56:18.304955 60809 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0518 19:56:18.305030 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.305175 60809 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0518 19:56:18.305240 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:56:18.305278 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.305317 60809 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0518 19:56:18.305418 60809 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0518 19:56:18.305707 60809 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0518 19:56:18.305798 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:56:18.305842 60809 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:56:18.305876 60809 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0518 19:56:18.305956 60809 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:56:18.306181 60809 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I0518 19:56:18.306272 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:56:18.306317 60809 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I0518 19:56:18.306377 60809 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0518 19:56:18.306479 60809 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0518 19:56:18.306545 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.306615 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.306642 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.306690 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.306727 60809 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0518 19:56:18.306783 60809 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0518 19:56:18.306875 60809 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:56:18.306910 60809 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0518 19:56:18.306967 60809 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:56:18.307047 60809 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I0518 19:56:18.307112 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0518 19:56:18.307177 60809 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I0518 19:56:18.307288 60809 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0518 19:56:18.307345 60809 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0518 19:56:18.307392 60809 internetgateways.go:66] CreateInternetGateway: { } I0518 19:56:18.307422 60809 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I0518 19:56:18.307507 60809 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0518 19:56:18.307570 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.307630 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.307658 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.307782 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:56:18.307827 60809 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0518 19:56:18.307888 60809 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0518 19:56:18.307978 60809 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0518 19:56:18.308095 60809 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0518 19:56:18.308177 60809 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0518 19:56:18.308234 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.308297 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.308325 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.308377 60809 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0518 19:56:18.308434 60809 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0518 19:56:18.308529 60809 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I0518 19:56:18.309137 60809 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender946017624/001 I0518 19:56:18.309514 60809 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender946017624/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I0518 19:56:18.310495 60809 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0518 19:56:18.310616 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.310781 60809 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0518 19:56:18.310851 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:56:18.310897 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.310957 60809 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0518 19:56:18.311165 60809 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0518 19:56:18.311504 60809 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I0518 19:56:18.311580 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0518 19:56:18.311636 60809 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0518 19:56:18.311726 60809 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0518 19:56:18.311800 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.311874 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.311906 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.311951 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.311994 60809 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0518 19:56:18.312060 60809 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0518 19:56:18.312185 60809 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I0518 19:56:18.312466 60809 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0518 19:56:18.312507 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.312588 60809 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0518 19:56:18.312622 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:56:18.312645 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.312667 60809 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0518 19:56:18.312705 60809 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0518 19:56:18.312794 60809 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0518 19:56:18.312833 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:56:18.312861 60809 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:56:18.312897 60809 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0518 19:56:18.312958 60809 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0518 19:56:18.313012 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.313060 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.313088 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.313132 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.313166 60809 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0518 19:56:18.313215 60809 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0518 19:56:18.313281 60809 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:56:18.313313 60809 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I0518 19:56:18.313461 60809 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0518 19:56:18.313528 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.313659 60809 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0518 19:56:18.313723 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:56:18.313763 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.313805 60809 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0518 19:56:18.313872 60809 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0518 19:56:18.313990 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.314015 60809 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0518 19:56:18.314096 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:56:18.314179 60809 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:56:18.314267 60809 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0518 19:56:18.314332 60809 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0518 19:56:18.314477 60809 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0518 19:56:18.314543 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.314621 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.314650 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.314697 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.314734 60809 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0518 19:56:18.314805 60809 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0518 19:56:18.314903 60809 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:56:18.314976 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.315052 60809 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I0518 19:56:18.315219 60809 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0518 19:56:18.315277 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.315406 60809 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0518 19:56:18.315470 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:56:18.315508 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.315542 60809 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0518 19:56:18.315602 60809 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0518 19:56:18.315834 60809 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0518 19:56:18.315912 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:56:18.315951 60809 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:56:18.316019 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.316142 60809 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0518 19:56:18.316187 60809 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0518 19:56:18.316296 60809 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0518 19:56:18.316360 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.316429 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.316457 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.316503 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.316538 60809 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0518 19:56:18.316597 60809 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0518 19:56:18.316733 60809 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:56:18.316810 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.316884 60809 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I0518 19:56:18.316967 60809 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I0518 19:56:18.317069 60809 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I0518 19:56:18.317186 60809 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0518 19:56:18.317247 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.317308 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.317335 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.317443 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:56:18.317488 60809 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0518 19:56:18.317540 60809 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0518 19:56:18.317599 60809 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:56:18.317768 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0518 19:56:18.317820 60809 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0518 19:56:18.317875 60809 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0518 19:56:18.317979 60809 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0518 19:56:18.318047 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.318112 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.318140 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.318197 60809 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0518 19:56:18.318261 60809 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0518 19:56:18.318353 60809 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I0518 19:56:18.318488 60809 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:18.318553 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.318709 60809 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0518 19:56:18.318771 60809 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0518 19:56:18.318812 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.318852 60809 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0518 19:56:18.318911 60809 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:18.318975 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0518 19:56:18.319045 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.319073 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.319137 60809 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0518 19:56:18.319182 60809 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I0518 19:56:18.319414 60809 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I0518 19:56:18.319516 60809 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:18.319585 60809 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I0518 19:56:18.319655 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0518 19:56:18.319683 60809 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0518 19:56:18.319738 60809 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.096s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.062s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.031s === RUN TestDiskRenderAzure I0518 19:56:18.263921 60812 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I0518 19:56:18.264346 60812 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I0518 19:56:18.264635 60812 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I0518 19:56:18.265391 60812 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I0518 19:56:18.265776 60812 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I0518 19:56:18.266146 60812 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I0518 19:56:18.266379 60812 resourcegroup.go:108] Creating a new Resource Group with name: rg I0518 19:56:18.266392 60812 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I0518 19:56:18.266620 60812 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I0518 19:56:18.267616 60812 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I0518 19:56:18.268004 60812 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I0518 19:56:18.268253 60812 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I0518 19:56:18.268773 60812 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I0518 19:56:18.269078 60812 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.042s === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.034s === RUN TestProjectIAMBinding I0518 19:56:19.712304 61602 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:19.712878 61602 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0518 19:56:19.712902 61602 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:19.713372 61602 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0518 19:56:19.713400 61602 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:19.713554 61602 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I0518 19:56:19.713684 61602 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:19.713774 61602 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0518 19:56:19.713798 61602 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:19.713910 61602 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0518 19:56:19.713934 61602 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:19.713999 61602 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I0518 19:56:19.714104 61602 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:19.714343 61602 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0518 19:56:19.714379 61602 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:19.714675 61602 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0518 19:56:19.714699 61602 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0518 19:56:19.714811 61602 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.061s === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.02s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.01s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.065s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.055s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.032s === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.031s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.006s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.039s === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I0518 19:56:23.217444 61998 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I0518 19:56:23.217523 61998 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I0518 19:56:23.217539 61998 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I0518 19:56:23.217557 61998 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I0518 19:56:23.217570 61998 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I0518 19:56:23.217583 61998 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I0518 19:56:23.217598 61998 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W0518 19:56:23.218310 61998 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.074s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.017s === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.019s === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.017s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.015s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.010s === RUN TestGetProxyEnvVars W0518 19:56:23.256593 62023 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.088s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.088s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.037s === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.020s === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.085s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W0518 19:56:25.945467 62088 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.086s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... >>> kops*: Package size: 147.7 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.4-r3.apk >>> kops: Build complete at Sat, 18 May 2024 19:58:56 +0000 elapsed time 0h 6m 46s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/5) Purging .makedepends-kops (20240518.195213) (2/5) Purging kubernetes (1.30.0-r1) (3/5) Purging go (1.22.3-r0) (4/5) Purging bash (5.2.26-r0) Executing bash-5.2.26-r0.pre-deinstall (5/5) Purging readline (8.2.10-r0) Executing busybox-1.36.1-r26.trigger OK: 378 MiB in 107 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...